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PREFACE 


This course of analysis is intended for mathematical specialists in 
their second and third years at Universities. We assume familiarity 
with the concept of a limit and its applications to infinite series and 
to the differential and integral calculus. The contents of A First 
Course in Mathematical Analysis by one of us (J.C.B.), which do not 
include Cauchy sequences, upper and lower limits or uniform con- 
vergence, form a suitable foundation for this book. From time to 
time we shall need to refer to a basic work on analysis and for 
simplicity we shall refer to the First Course, shortening its title 
to Cl. 

An undergraduate after his first year should be ready for a more 
abstract setting and prepared to think in metric spaces instead of the 
Euclidean line or plane. The study of metric spaces provides not only 
a means of unifying different topics in analysis but also a natural 
link with topology. 

Chapters 1-9 concentrate on general analysis and real functions 
and 10-14 on complex functions. These last five chapters are largely 
independent of 6-9, and the reader who wishes to reach Cauchy’s 
theorem quickly needs little more than §8.1 and §8.2. 

After careful thought we decided to treat the Riemann and 
Riemann-Stieltjes integrals fully (chapters 6 and 8) and to leave the 
Lebesgue integral out. For many purposes the Riemann integral is 
sufficient, and the inclusion of an adequate account of Lebesgue 
measure and integration would impair the balance of the book. 

We are very grateful to Dr L. Mirsky and to Professor G. E. H. 
Reuter, each of whom has read the entire manuscript. The final form 
of it owes a great deal to their care and vigilance and to the experience 
which they gained from their own teaching. 

J.C.B. 
August 1968 H.B. 
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1 
SETS AND FUNCTIONS 


1.1. Sets and numbers 


It has been recognized since the latter part of the nineteenth 
century that the idea of number (real and complex), and therefore all 
analysis, is based on the theory of sets. In modern analysis the 
dependence is explicit, for the language and algebra of sets are in 
constant use. 

The reader is likely to be familiar with the intuitive notion of a set 
and with the basic operations on sets. In this section we therefore 
confine ourselves to fixing the terminology and recapitulating the 
results that will be used subsequently. The notes at the end of the 
chapter refer to books which develop set theory systematically from 
explicitly stated axioms. 

There are synonyms for the word set such as collection and space. 
The members of a set are also called its elements or points. The 
statement that a belongs to (or is a member of) the set A is written 


acd, 
If a does not belong to A we write 
a¢A. 


We denote by @ the empty set, namely the set which has no 
members. 


Inclusion of sets. Suppose that every member of the set A also 
belongs to the set B, i.e. that 


xeA>xeB. (1.11) 
Then we say that A is contained in B and write 
ACB or B>A; 


the set A is said to be a subset of B. Note that any set is a subset of 
itself. Also the empty set is a subset of every set; for (1.11) is logically 
equivalent to Pest 


and, when A is the empty set, this implication clearly holds for any 
set B, 
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If A < Band BC A, ie. 
xeA>xeB, 
then A and B have the same members and we write 
A=B. 
If A < Band A + B, we can call A a proper subset of B. 


Union and intersection. Given any two sets A, B, the set which 
consists of all the elements belonging to A or to B (or to both) is 
called the union of A and B and is denoted by 


AUB. 


The set consisting of the elements which belong to both A and B is 
called the intersection of A and B and is denoted by 


AnB. 
The sets A, B are said to be disjoint if they have no elements in com- 
mon, ie. if ANB= o. 
Theorem 1.11. The following identities hold for any sets A, B, C. 
(i) AUB = BUA, ANB= BNA; 
Gi) AU(BUC) = (AUB)UC, An(BnC) = (AnNB)nC; 
(iii) AU(BN C) = (AUB)n (AUC), 
An(BuC) = (An B)u(AnNG). 

Proof. We illustrate the argument used for establishing these 
identities by proving the first result in (iii). 

Let x be any element of A4U(BN C). Then xe A or xe BNC. If 
xeéA, then xe AUB and xe AUC, so that xe(AU B)N(AUC). 


If xe Bn C, then x e Band x € Cso that again xe (AU B)n (AUC), 
We have therefore shown that 


AuU(BNC) < (AUB)N (AUC). (1.12) 


Now let ye(AUB)n(AUC). Then ye AUB and yeEAUC. It 
follows that y € A or that ye Band ye C, i.e. that ye Aorye BNC. 
Hence y € A U(BN C) and so 

(AU B)n(AuC) < Au(BNC). (1.13) 


The inclusion relations (1.12) and (1.13) now yield the required 
identity. | 
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The laws of operation with U and / on sets have some likeness 
to those with + and x on numbers. In fact U and n have replaced 
the signs for sum and product formerly used in the algebra of sets, 
The likeness is only partial: the identity AU A = A has no analogue 
in numbers; the second law in theorem 1.11 (iii) has an analogue, but 
not the first. 

The definitions of union and intersection previously given may be 
extended. If @ is an arbitrary collection of sets, the union of these 
sets, denoted by UA 


Ace 
is the set consisting of all those elements which belong to at least one 
of the sets A. The intersection of the sets of ©, denoted by 
nN A, 


Ace 


is the set consisting of the elements which belong to all the sets A. 
We require one more operation with sets. If A, B are any two sets, 
the difference A-B 


is the set consisting of those elements which belong to A but not to B. 
Note that the definition does not require B to be a subset of A. How- 
ever a particularly important case occurs when all sets under con- 
sideration are subsets of a given set X. Then the set X—A is called 
the complement of A (relative to X) and we shall denote it by A’. 
Clearly (A’)’ = A. 


Theorem 1.12. For any collection © of subsets of a set X, 
(U A!’ = NA’ and (N A! = U A. 
Ace Ac€ 


Ac@ Ac€ 

The proof is left to the reader, 

Theorem 1,12 shows that the operations U and () are comple- 
mentary and that an algebraic identity involving U and () will admit 
of a dual identity obtained by interchanging U, (. For example, in 
each pair of identities in theorem 1.11 the second follows from the 
first. 


We shall take for granted that the reader is familiar with the systems 
of real and complex numbers. There are well known and simple 
methods for obtaining the complex numbers from the real numbers. 
For our purposes it is only necessary to postulate the existence of the 
system of real numbers as one satisfying certain axioms which are 
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given in C1 (11-12) and are restated in the notes at the end of the 
chapter. However, it is possible to construct the real numbers from 
much more primitive objects. Again the notes contain some remarks 
on the subject. 

The set of real numbers will be denoted by R', the set of complex 
numbers by Z. Our notation for the open interval in R* which consists 
of the points x such that a < x < is (a, b). The closed interval of 
points x such that a < x < b is written [a, 4]. The intervals defined 
bya < x < banda < x < bare written [a, b) and (a, b]. The infinite 
interval [a, 00) consists of the points x such that x > a. Correspond- 
ing interpretations are put on the expressions (a, 2%), (—%, a), 
(—©, a]. Finally, (— 00, 00) is R'. 


Exercises 1(a) 
1. Prove that 


(i) AUB=A+A>B; (ji) ANB=A+ACB. 

2. Prove that 
(BU C)n(Cu A)n (AUB) = (BN C)U(CN A) U (AN B). 

3. Show that A—B = An B’. Hence or otherwise prove that 

(i) (A-B)n (A-C) = A-(BU C) = (A—-B)-C; 

(ii) (A—B)U(A-C) = A-(BNO); 

(iii) (A—C) n (B—C) = (An B)-C; 

(iv) (A—C)U(B-C) = (AU B)-C. 
4. Prove that 

(i) (A—B)N C = (ANC)-(BNQ); 

(ii) (A-B)U C = (AUC)-(BUC) = C= @. 
5. Prove that 

(i) (AUB)—-B = A=ANB= @; 

(ii) (A-B)UB = A=+A>B, 


6. The symmetric difference A 4 B of the sets A, Bis defined as the set of elements 
in A or in B, but not in both. Show that 


AA B= (A—B)U(B-A) = (AU B)—(AN B) = (AU B)n (AU BY. 
Deduce that 
@) AAB= 8<+A=B; (ii) A.A B= AAB. 
7. Prove that 
(i) AAB=BAA;_ (ii) (AA B)AC=AA(BAC). 
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8. Prove that 

(i) (4A B)NC = (ANC)A (BNO); 

(ii) (A A B)UC = (AUC) A (BUC) + C= @; 

(iii) (A A B)U(A A C) = (AU BUC) (4’U BUC). 
9. Show that AAXAB=CAD#+AAC=BAD. 


10. When Fis a finite set (i.e. one with finitely many elements), denote by | £| the 
number of its elements. 
Show that, if the sets A, B are finite, then 


|A|+|B| = |Au Bl+|An Bl. 


1.2. Ordered pairs and Cartesian products 
A set with elements a, b, c, ... is often denoted by the symbol 


{a, b,c, ...}- (1.21) 


The notation calls for a number of comments. 

(i) Insuch a listing of elements it is immaterial whether a particular 
element appears once or several times. This convention is purely a 
matter of convenience. For instance it allows us to denote the set of 
roots of a complex quadratic equation by {a, b}, whether a + 5 or 
a=b, 

(ii) The order in which a, b, c, ... are written in {a, 5, ¢, ...} has no 
significance. For example {a, b} = {b, a}. 

(iii) It is important to distinguish between the object a and the 
set {a}, i.e. the set whose only member is a. Thus the set {9} has one 
element, while @ has none. 

The notation (1.21) has a useful variant. Given a set X, denote by 
P(x) a statement, which is either true or false, about the element 
x of X. The set of all x ¢ X for which P(x) is true is written 


{x € X|P(x)}, 
or simply {x|P(x)} 
if the identity of the set X is clear from the context. 


Illustrations 
(i) &eZ|x*+1 = 0} = fi -1; 
di) {xe R4jx4+1 = 0} = 2; 
(iii) {x € R'|a < x < 5} = [a, b). 
The notion of a set does not involve any ordering among the 
elements. For instance in the set {a, b}, a and b have the same status. 
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The ordered pair (a, b) is the set {a, b} together with the ordering ‘first 
a, then b’. Thus (a, 5) and (6, a) are different unless a = b. (The 
context will determine whether the expression (a, b) stands for an 
ordered pair or an open interval.) 

The intuitive concept of an ordered pair (a, b) may be formalized 
by the definition (@, b) = {a}, {a, B}. 
(See exercise 1(b), 1.) 

An ordered set (a), ..., @,) of any finite number” (> 1) of elements 
is defined in a similar way. 


Definition. Given the non-empty sets X,,...,X,, their Cartesian 
product Xx xX, (1.22) 
is the collection of all ordered sets (xy, ..., X,) such that 
Hy EA yy 5085 Ay CA gs 

If X, =... = X, = X, the set (1.22) is denoted by X"; X is taken to 
be X. 

For n > 1, R” = R'x...x R' (n factors) is the set of all ordered 
sets (x;, ..., X,) of real numbers. We define an interval in R” as a set 

TeX acemles 


where J,, ..., J, are intervals in R'. For example [a, b] x [c, d] is the 
set of points (x, y) € R? such thata < x < bande <y<d. 


1.3. Functions 

Let X, Y be two non-empty sets. A relation from X to Y is a subset 
of Xx Y, Ifa relation f, i.e. a subset of Xx Y, is such that, for every 
x € X, there is one and only one member (x, y) of f, then fis said to be 
a function on X to (or into) Y; we express this symbolically by writing 


jix=% 


The set X is called the domain of f. 

In some contexts the terms mapping, transformation, or operator 
are often used as synonyms for function. Let (x, y) be an element of 
the function f: X¥ > Y. Then we say that y is the value of f at x (or 
the image of x under f’) and we write y = f(x). If E is any subset of X, 


the subset of Y (ye Yly =f) and xeE} 


is called the image of E under /; it is denoted by f(E). The set f(X) is 
called the range of f. Note that /(X) may be a proper subset of Y. 
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If a function f has its domain in X and its range in Y, we say that 
fisa function from X to Y. A function from R! to R! will be called a 
real function, a function from Z to Z a complex function. 


Mlustrations 


(i) We obtain a function on X to Y whenever we have a rule for assigning a 
single value y in Y to each x of X. Thus the equation x*+y* = 1 defines a 
function on R! to R' whose range is (—, 1]. 

(ii) The equation x*+y? = 1 defines a relation but not a function on [—1, 1] 
to [—1, 1] because, whenever — 1 < x <1, it is satisfied by two values of y. 

(iii) The logarithmic function is the function on (0, 2) to R! which assigns 
the value log x to the positive number x. 

(iv) The sequence ay, a, a, ... is a function whose domain is the set of positive 
integers exhibited as suffixes. 

More generally, given two arbitrary non-empty sets A, J and a function on J to 
A, we sometimes find it convenient to write the image of a member i of / in the 
form a. 

(v) Denote by ® the set of all real functions ¢ defined by an equation of the 


form 
d(x) = axt+fh (xe R}), 


where , # are real numbers. A function f: R? > ® is obtained by assigning to 
each point (a, b) € R® the function ¢,,, given by $o,.(x) = ax+b (xe R’). 


Let f be a function on X into Y. If f(X) = Y, ie. if every ye Y is 
the image under f of at least one x € X, then we say that fis surjective, 
or that f maps X onto Y. 

If different elements of X have different images, i.e. if f(x) = f(x’) 
implies x = x’, then fis called injective. 

If f is both surjective and injective, so that every value y in Y is 
assumed once and once only, then fis said to be bijective. A bijective 
function is also called a bijection; it effects a one-to-one correspondence 
between its domain and range. 

Consider again the illustrations above. 

(i) The function maps R? onto (—©, 1]; it is not injective. 

(iii) The logarithmic function is a bijection on (0, 00) to R'. 

(v) This function is a bijection on R? to ®. 


Inverse functions. Suppose that the function f has domain X and 
range Y. To f, which is a subset of X x Y, there corresponds the sub- 


set of Y x X defined as 
(0, IQ, ») €f}. (1.31) 


Plainly this is a function with domain Y and range X if and only if f 
is bijective. When f is bijective, (1.31) is called the inverse function 
of f and is denoted by f. For instance the logarithmic function has 


8 SETS AND FUNCTIONS [1.3 
an inverse with domain (—00, 00) and range (0, 00); the inverse is 
the exponential function. 

If the function f: X + Y is injective, then f: X + f(X) is bijective 
and f: f(X) > X is a function from Y to X. For example the 
function f: R! > R! defined by 

1 
f= Tre 


has the inverse f-!: (0, 1) > R' given by 
1 
F-) = tog (5-1). 
It is clear that, if f has an inverse, then f' has an inverse and 
G4) =7 
Inverse images. Let f: X > Y be an arbitrary function and let E 
be any subset of Y. We denote by f(£) the set 
{x € X|f(x) € E}. 
This set is called the inverse image of E. It is important to note that 
the definition of f(£) does not presuppose the existence of the 
inverse function f-'. However, when f~ does exist, then f(£) is the 
image of E under f. 
If f is the function in (i) on p. 7 then, for example, 
F-(@, 1) = (1, 0); 
the function f-! does not exist. 
Composition of functions. Given the functions f: ¥ > Y and 
g: Y>W, the function h: X > W defined by 
h(x) = s{f@)} (we X) 
is called the composition of g and f and is written go f. 
For three functions f,: X; > X2, fo: X2> Xs, fa:Xg > Xs, we 
clearly have fro (fof) = (hofsoh 
so that the expression f;0 f,0 f, has a meaning. The process of com- 
position may be extended to any number of functions. 
For a non-empty set A, denote by i, the identity function on A 
defined by i,(x) =x (xe€A). 
If, now, f: ¥ > Y is any function, 
foix=f, iyof=f; 
and, when / is bijective, 


frof=ix, fof = iy. 


1.3] FUNCTIONS 2: 


Theorem 1.31. 

(i) If the function f: X + Y is surjective and if there is a function 
g: YX such that go f = ix, then f is bijective and g = f. 

(ii) If the function f : X > Y is bijective and if the function g: Y > X 
is such that fog = iy, theng = f-. 

Proof. 

(i) If f(x) = f(x’), then 

x = gf} = s{f(x)} = x" 
and so fis injective as well as surjective. We now have 
g = goly = go(fof) = (gofjof? = ixof? =f. 
(ii) g = ixog = (ftof)og =fto(fog) =froiy =f. | 


In theorem 1.31 (ii) the bijectiveness of f is not a consequence of 
surjectiveness, as it is in part (i). For instance let ¥ = {a, b} (a + 6), 
Y = {c} and let f, g be defined by f(a) = f(b) = ¢, g(c) = a. Then f 
is surjective and fo g = iy, but fis not bijective. 

If the functions f: ¥ > Y, g: Y> W are bijective, then go/: 
X + W is bijective. It follows from theorem 1.31, or it may be 
proved directly, that (gof)2 = ftog. 

Restriction and extension of functions. Suppose that X, > X, and 
that f: X, > Y, g: X, > Y are functions such that f(x) = g(x) for 
all x € X,. We then say that g is the restriction of f to X, and that fis 
an extension of g to X,. For example let f,: Rt > R! and f,: R' > R* 
Degen rN Gye x, AG) <x] eR), 

The function g: [0, 00) + R! defined by 
g(x) =x (x 20) 
is the restriction to [0,«) of both f, and fy; and f,, f, are both 
extensions of g to R'. 
Exercises 1(4) 
1. Show that {{a}, {a, b}} = {{c}, {c, d}} if and only if a = c and b = d. 
2. Prove that 

(i) (AU B)x C = (Ax C)U(Bx C), 

(ii) (An B)x C = (Ax C)n(Bx ©), 

(iii) (A— B) x C = (Ax C)—(Bx C). 
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3. Prove that 4x B = Bx A if and only if A = B. Is (Ax A)x A necessarily the 
same set as A x (A x A)? 


4. Show that {a} x {a} = {{{a}}}. 


5. Let © be a collection of subsets of a set ¥. Prove that, for any function 
S:X7Y, 
@fCU_ A= U f(A), Gi SCN ADS N f(A). 
Acé Ace Acé Ace 


Show that, if fis injective, then identity holds in (ii); and that /is injective if 
S(A 1 B) = f(A) n f(B) 
for all subsets A, B of X. 
6. Show that, if f: ¥ > Y is any function, then 
S(A—B) > f(A)—f(B) 
for all subsets A, B of X; and that identity holds for all A, B if and only if fis 
injective. 
7. Let @ be a collection of subsets of a set Y. Show that, for any function 
fF Kee Y, 
@f*(U B= U f°), Wf*(N B= 1 f*@. 
Bee Bee Bet Bee 


8. Show that, iff: ¥ + Y is any function, then 
f-(C— D) = f-(C)—f-(D) 
for all subsets C, D of Y. 
9. Show that, if f: ¥ + Y is any function, then 
@ f(A) > A, Gi) FB) < B 


for all subsets A of X and all subsets B of Y. Prove also that in (i) identity holds 
for all A if and only if fis injective; and in (ii) identity holds for all B if and only 
if f is surjective. 


10. The functions f,: X, > Xo, fo: X, > Xo, fa: X3 > X, are such that the 
compositions fyo f, : X; > X; and fo fy: X_ > X, are both bijective. Show that 
Sis Say Sy ave all bijective. 


11. Let R bea relation from X to X (i.e. a subset of ¥x X) and write xRy when 
(x, ») € R. The relation is said to be 
(i) reflexive if xe X > xRx; 

(ii) symmetric if xRy + yRx; 

(iii) transitive if xRy and yRz > xRz. 

Criticize the following ‘argument’. The relation R is known to be symmetric 
and transitive. Writing x for z in (iii) and using (ii) we obtain xRy + xRx. Hence 
R is reflexive. 


1.4, Similarity of sets 


If there is a one-to-one correspondence between two sets A, B, 
i.e. if there exists a bijection f: A > B, then the two sets are said to 
be similar and we write TRE) 
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It is easy to see that similarity has the following three properties: 
(i) A ~ A (reflexivity); 

(ii) if A ~ B, then B ~ A (symmetry); 

(iii) if A ~ Band B ~ C, then A ~ C (transitivity). 

If we confine ourselves to a given collection @ of sets, then simi- 
larity is a relation from @ to @ and, in view of (i)-(iii) above, it is an 
equivalence relation. The reader has probably met such relations in 
other branches of mathematics, particularly algebra. 

Finite sets are similar if and only if they have the same number of 
elements. This implies, in particular, that a finite set cannot be 
similar to a proper subset of itself. We shall see that infinite sets 
always contain proper subsets to which they are similar (theorem 1.42, 
corollary). A simple example is the following. Let A be the set of all 
integers and let B be the set of all even integers. Then A ~ B, since 
the function given by y = 2x (x € A, y € B) establishes the required 
one-to-one correspondence. 

A set which is similar to the set {1, 2, ...} of positive integers is said 
to be countably (or enumerably) infinite. Such a set is therefore one 
that can be arranged as a sequence. A set is called countable if it is 
either finite or countably infinite. 

We now show that there are infinite sets which are not countable. 


Theorem 1.41. The set of real numbers in the interval (0, 1) is not 
countable. 


Proof. Suppose that the real numbers in the interval (0,1) do 
form a countable set. This set is certainly infinite and can therefore 


be arranged as a sequence 
Ay, Ag, Ag, «+++ 


Now represent each number a,, as an infinite decimal 
Ay = 0. ny Sno ng» 


in which recurring 9’s are not used. Such a representation is unique. 


Define 
Bn = : when @,, = 1. 


Then b =0.f;hohy --. 


is a real number between 0 and 1 which differs from a, in the nth 
decimal place. Hence b is not one of the numbers ay, dy, dg, ... and 
this contradicts the original assumption that all real numbers in the 
interval (0, 1) appear in the sequence (a,). | 


1 when a,, + 1, 
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Countably infinite sets are the ‘smallest’ infinite sets in the sense 

of the theorem below. 

Theorem 1.42. Every infinite set contains a countably infinite subset. 


Proof. Let A be an infinite set. Take some element of A and call 
it a,. The set A—{a,} is not empty; denote one of its elements by a). 
This process may be continued indefinitely: at the mth stage the set 


A={ay, «..5 An} 
cannot be empty since 4 is infinite. The set {a,, dy, ...} is a countably 
infinite subset of A. | 
Corollary. Every infinite set contains a proper subset to which it is 
similar. 


Proof. Let A be an infinite set and let S = {a,, a;, ...} be a count- 
ably infinite subset of A. The function f: A > A—{a,} defined by 


a if = hae = D2 s wy 

Hem [nv ( ) 
lx ifxeA-S 

is a bijection. Thus A ~ A—{a;}. | 


The next theorem is frequently used. 
Theorem 1.43. Every subset of a countable set is countable. 


Proof. Let A be a countable set and let B be a subset of A. When B 
is finite there is nothing to prove. Assume therefore that B is infinite, 
so that A is infinite and, being countable, can be arranged as a 
sequence (a,,). Since every set of positive integers has a least member, 
there is an element a,, of B with least suffix n. Next let a,, be the 
element of B—{a,,} with least suffix m. The procedure may be 
repeated indefinitely since B is not finite. The sequence 


Gage dat Gngslen: (1.41) 


consists of elements of B and, in fact, exhausts B. For take any element 
of B. It is of the form a,, since it is a member of A, and it must there- 
fore occur among the first k elements of the sequence (1.41). Hence B 
is countable. | 


Theorem 1.44. The set P? of all ordered pairs (p, q) of positive integers 
is countable. 
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Proof. The elements of P?, all of which appear in the array 
(1, 1), (1, 2), Cs 3), +3 
(25a); C2532)51(2)53) 5 cay 
Mott ogeks (oe by, sos 


may be arranged as a sequence in several simple ways. Perhaps the 
simplest is the enumeration by diagonals: 


, 1); @, 1), G, 2); G1), @, 2), (1, 3); «5 
oDnGe=1,2)s <3. pn) sien] 


Exercise. Show that the set P" (n > 2) of all ordered sets (py, ..., DP) of 1 positive 
integers is countable. 


Theorem 1.45. The union of a countable collection of countable sets 
is countable. 


Proof. Let {A, Ag, ...} be a finite or countably infinite collection 


of countable sets. If 


n-1 
B, = Ay, B, = An,-—U A, (> 0), 
k=1 


then the B, are mutually disjoint and 
UA, = UB, = C, 


say. (The non-committal notation U is used since the number of sets 
n 


may be finite or infinite.) By theorem 1.43 each of the sets B,, is 
countable. Therefore, if B,, is not empty, its elements may be arranged 
in a possibly terminating sequence 
Dry ngs +++ 
Now let S be the subset of P? which contains a pair (p, 9) if and only 
if B, is either infinite or has at least gmembers. By theorems 1.43 and 


1.44, S is countable. Since there is an obvious one-to-one correspon- 
dence between S and C, it follows that C is countable. | 


Theorem 1.46. 


(i) The set of all rational numbers is countable. 
(ii) The set of all irrational numbers is not countable. 
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Proof. A given positive rational number is uniquely representable 
in the form p/g, where p,q are coprime positive integers. With this 
number we now associate the ordered pair (p,q). Thus the set of 
positive rational numbers is similar to a subset of P? and is therefore 
countable. Part (i) now follows easily by use of theorem 1.45. 

Since the set of real numbers in (0, 1) is not countable, by theorem 
1.43 the set R? of all real numbers cannot be countable. If now the set 
of irrational numbers were countable, (i) and theorem 1.45 would 
show R? to be countable. | 


Instead of considering all rational and irrational numbers we may 
restrict ourselves to those in any given interval. It follows immediately 
from theorem 1.43 that the analogue of (i) holds. The analogue of 
(ii) can then be proved as before by using exercise 2 below. 


Exercises 1(c) 
1. Let C be a countable set. Show that, if A is any infinite set, then 
AUC~A; 
and that, if B is an uncountable set, then 
B-C~B. 


2. (i) Show that all finite open intervals in R’ are similar. 
(ii) Show that all open intervals in R? are similar. 
(iii) Show that all intervals in R? are similar. 


3. Let @ be a countable collection of disjoint sets such that, for all Ae@, 
~ Ri 
A ~ R'. Show that teeters 
Acé 


4. Show that, if the sets 4,,..., A, are countable, then so is A,x...* A, (In 
particular, if Q is the set of rational numbers, then Q" is countable.) 


5. Let P be the set of all sequences of 0’s and 1’s. Using the binary representation 
of real numbers prove that F is similar to the interval (0, 1). 

Show also that 7? ~ F and deduce that, if the sets 4,,..., A, are similar to 
R', then A,x...x A, ~ R'. (In particular, R" ~ R'.) 


6. Prove that the set of all polynomials 
AX" FAX A+... + An rX+An 


with integral coefficients is countable. Deduce that the set of algebraic numbers 
is countable. (An algebraic number is a number which is a root of an algebraic 
equation with integral coefficients.) 


7, Let R;(0 < i < 9) be the set of those real numbers in (0, 1) which do not use 
the numeral / in their decimal representation. Prove that R,; ~ (0, 1). (Suppose 
that recurring 9’s are not used.) 
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8. A set E of real numbers is such that every series 


© 
x Xns 
n=1 
whose terms are distinct elements of E, converges. Show that E is countable. 


9. Given a set A, denote by %4 the set of subsets of A (including @ and A). 
Show that 
(i) if A has n elements, then .%4 has 2” elements; 
(ii) if A is countably infinite, then Ys ~ R?; 
(iii) if A is any set, then A + 4 (though clearly A is similar to a subset of 
Sa). 


10. Show that any collection of disjoint open intervals of R' is countable. 
Deduce that, if J is any interval in R' and the function f: J > R! is monotonic, 
then the set of points of discontinuity of / is countable. 

(If c€J and c is not an end point, then 


S(e+) = amr Gs f(e—) = lim f() 
exist; see C1, 32.) 


NOTES ON CHAPTER 1 


§1.1. Axiomatic set theory. The intuitive notion of a set, though perfectly 
adequate for everyday use by analysts, is, in fact, self-contradictory. To demon- 
strate this we describe the famous Russell paradox. A set may or may not be a 
member of itself: most sets are not and we call these normal; an example of a set 
which is a member of itself is the set consisting of all infinite sets (for clearly 
there are infinitely many of these). Consider the set N of all normal sets. Is N 
normal or not? If N is normal, then, by definition of normality, N ¢ N; but, by 
definition of N, a set which does not belong to N is not normal and we have a 
contradiction. The supposition that N is not normal is equally untenable. The 
mathematician’s way out of this dilemma is to construct an axiomatic system 
designed to mimic the desirable features of the intuitive approach and to avoid 
its pitfalls. The axiomatic theory of sets is described in Theory of Sets and 
Transfinite Numbers by B. Rotman and G, T, Kneebone. A more informal atti- 
tude is adopted by P. R. Halmos in Naive Set Theory. 

The theory of sets is the starting point of the monumental Eléments de 
Mathématique, which is designed to present the whole of pure mathematics in 
strictly logical order. This work, by a group of French mathematicians writing 
under the collective name of N, Bourbaki, has been appearing in sections since 
1939 and is not yet (in 1969) complete. 

The real number system. The set R' of real numbers, together with the operations 
of addition and multiplication and an ordering relation, is an ordered field: it 
satisfies the following six algebraic and three ordinal axioms. 

A1. To every pair of real numbers a, b correspond a real number a+, the 
sum of a and b, and a real number ab, the product of a and b. 

A2. a+b = b+a; ab = ba. 

A3. (a+b)+c = a+(b+c); (abe = a(bc). 

A4. There are real numbers 0, 1 such that 


O+a=a and la=a 
for all real numbers a. 
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AS. For every real number a, there is a real number x such that a+x = 0. 

For every real number a, other than 0, there is a real number y such that 
a=1. 

A6. (at+b)c = acthe. 

O1. For every two real numbers a, 6, one and only one of 


a>b, a=b, b>a 
is true. 

O02. Ifa > bandb>c,thena>c. 

O03. Ifa > b, thena+c > b+c; if also c > 0, then ac > be. 

What distinguishes the real number system from other ordered fields is 
Dedekind’s axiom: 

If L, R are two non-empty sets of real numbers such that LU R = R' and 
every member of L is less than every member of R, then either L has a largest 
member or R has a least member. 

The construction of such a richly endowed system is, not surprisingly, a major 
undertaking. The first step is to obtain the natural numbers 0, 1, 2, ...; and the 
most satisfying way of doing this is to use only the machinery of set theory (see, 
for instance, Halmos’s Naive Set Theory). Another possibility is to begin with 
the set of natural numbers, but to assume no more than a few simple properties 
(Peano’s axioms). This approach is adopted by L. W. Cohen and G. Ehrlich 
(The Real Number System), E. Landau (Foundations of Analysis) and H. A. 
Thurston (The Number System). There are now standard algebraic methods for 
proceeding first to the integers (0, +1, +2, ...) and then to the rational numbers. 
At this stage we have arrived at an ordered field which does not, however, satisfy 
Dedekind’s axiom. There are two principal constructions for the final step to 
the real numbers. The method of cuts is mentioned in C1 and is given in detail 
by Landau. Cauchy (or fundamental) sequences are used by Cohen and Ehrlich 
and by Thurston. This process is also described in the notes at the end of 
chapter 3, since it is closely related to some of the contents of that chapter. 

An ordered field is said to be Archimedean if, given any member of the field, 
there exists a larger integral member; an equivalent property is that between any 
two members of the field there is a rational field element. The real number system 
is of this kind, as is shown in (6) on p. 73. 


2 
METRIC SPACES 


2.1. Metrics 


Classical analysis deals with sets of points in and functions defined 
on Euclidean space or the complex plane, while in more recent 
developments prominent parts are played also by other types of 
spaces. These spaces lead to theories with many similar features. The 
reason is that the spaces share the same underlying structure. It is 
therefore both illuminating and also economical of effort to develop 
many aspects of analysis in a general setting which includes as special 
cases the various spaces of particular importance. A fundamental 
property which these spaces have in common is that in all of them 
there is a distance between any two points. We now lay down the 
conditions which such a distance function or metric must satisfy. 


Definition. Suppose that X is a (non-empty) set and that p is a real 
valued function on X x X with the following three properties. 

M1. p(x, y) > 0 for all x,y eX and p(x,y) = 0 if and only if 
x=yYy; 

M2. p(x, y) = p(y, x) for all x, y € X; 

M3. p(x, 2) < p(x, y)+p(y, 2) for all x,y,zeX (the triangle 
inequality). 

The function p is called a metric or distance on X; and X, taken 
together with the metric p, is called a metric space which we denote 
by (X, p). 

The notation (X,) emphasizes the fact that the set ¥ and the 
metric p have equal shares in the construction of the metric space. 
A given set may give rise to many different metric spaces by having 
different metrics associated with it. Nevertheless, when it is clear 
which metric is being used we may, for brevity, write X rather than 
(X, p) for the metric space. 


Mlustrations 
(i) Any set X can be equipped with a metric; 
- (0 ifx=y, 
P(x, ¥) Vile y 


is such a metric, but not a very interesting one. (This metric is called the discrete 
metric.) 
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(ii) On R! the usual metric is given by 
p(x, y) = |x—-yI. 
The usual metric on R" is defined as follows. If 
X= ry ey wy Y= Oy er nd ER 
P(X, Y) = VO VP + oe + n= Ind" (2.11) 


The case n = 1 gives the earlier definition of the usual metric on R’. 
Plainly p satisfies M1 and M2. Putting a; = x;— yi, b; = yi—Z, We see that 


M3 is equivalent to 
n + n n 
(Eason) <(Ea) +(E v) 
it i=1 i=1 


By squaring both sides of (2.12) we obtain yet another equivalent form, namely 
n n bya + 
¥ ab < (= a) (3 vi) : (2.13) 
i1 i= i=1 


This now follows from the fact that, for all real , 


i + 
: (2.12) 


3S (a+b)? = Ag+ 2HE+B > 0, 
i=1 


so that H® < AB, 
n n n 
where A=, H= aby B= DX bi. 
i=1 i=1 i=1 


Therefore p, defined by (2.11) is a metric. 
The metric space (R", p), where p is the usual metric, is called n-dimensional 
Euclidean space. 
(iii) On Z, the complex plane, the usual metric is of the same form as that 
on R?. If z = x+iy and z’ = x’+ iy’ (x, y, x’, y’ real), 
plz, 2’) = |z—2"| = r—- xP + 0-9}. 


In fact, when equipped with their usual metrics, Z and R® are essentially the same 
metric spaces in which only the notations differ. 
(iv) Let Bla, 6] be the set of bounded real functions on the interval [a, 5] and, 


forfge Bla, ble icy 9) = sup ‘ |f)—g@)|. 


asrs 
Clearly p has the properties M1 and M2. M3 follows from the inequalities 
sup |9(x)+4(x)|_< sup (|A(x)| + |¥@)|) < sup |¢@)|+sup |YO)|. 
(v) Let S be the space of sequences x = (x, X2, ...) of complex numbers such 
that Xx, converges absolutely. For x, y¢ S put 
w 
PY) = DX [Xn Ynl- 
nel 
It is easy to show that p is a metric on S. 


Let (X, p) be a metric space and let Y be a subset of X. If o is the 
restriction of p to Y~x Y, ie. o(x, y) = p(x, y) for all x,y € Y, then 
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¢ is a metric on Y; it is said to be the metric induced by (X, p) on Y. 
The metric space (Y, @) is called a (metric) subspace of (X, p). For 
instance let R® have its usual metric p given by 


P(x, ») = {1 Ys)? + 2 Ya)" + (Xs —Ys)"}- 
If Y is the set of points x ¢ R* with x, = c, the metric o induced on 
Yis given by a(x, y) = Vy)? + 2-2) 
In future, unless there is a statement to the contrary, the metrics 


on R” and Z will be taken to be the usual metrics; and subsets of R” 
and Z will be taken to have the metrics induced by the usual ones. 


Sequences of points. The following definition extends the notion of 
convergence of sequences of real numbers to sequences of points in 
a metric space. 


Definition. The sequence (X,) of points in the metric space (X, p) is 
said to converge to the point x(< X) if 


P(Xn xX) >0 as n>. (2.14) 


We write, as in classical analysis, x, > x as n > 00 or lim x, = x. 


no 
Since p(x, y) is a real number, we are able to use the concept of 
convergence in R!. We could replace (2.14) by the phrase ‘given 
e > 0, there is an 7 such that p(x,, x) < € for n > m’. This form 
of the definition reduces to the familiar definition of a convergent 
sequence of real numbers when (X, p) is R1 with its usual metric. 


Exercise. Prove that a sequence cannot converge to two distinct limits. 


Illustrations 
) In ayes 5) 
(i) In R? let Xn (or ee) L 
Then, as n + 00, Xn > G; 2), 


since PCE ns 2) = (ee) * ea} am 


(ii) In Bll, 2] with p(y g) = sup |f(x)—g(x)|, let f, be given by 
l<z< 


Sn(x) = (1+x")"" (1 < x < 2), 
Then firl 


where f@=x (l<x <2). 
For, when 1 < x < 2, 


0 < fi)—S(X) = xGr"+ I= x << x(2¥"—1) < 22""—1) 
and so PUfn, f) < 2022%"-1) 20 as n>, 


20 METRIC SPACES [2.1 


When the metrics p, o on a set X are such that, as n > 00, x, > xX 
in (X, p) if and only if x, > x in (X, 0), then p and @ are said to be 
equivalent metrics. We shall see, as the theory develops, that a change 
to an equivalent metric preserves many of the properties of a metric 
space. 

A sufficient, though not necessary condition for the metrics p, 7 
to be equivalent is the existence of strictly positive constants A, 
a Aolx, ¥) < o(%, 9) < He(%Y) 


for all x, y € X. (See exercise 2(a), 7.) 


Exercises 2(a) 


1. Is the function p given by p(x, ¥) = |x*—y*| a metric on (a) (—%, &), 
(6) [0, 20)? 


2. Let C be the set of bounded and continuous real functions on R' and let p be 


defined by a 
pt, = sup | f° teo-Yeor dr 


-o<r<0 
0<h<1 


Show that p is a metric on C. 


3. Let X be a non-empty set and let p be a real-valued function on Xx X such 
that 


(i) p(x, y) = 0 if and only if x = y; and 
(ii) p(x, ») < p(x, z)+ eC, z) for all x, y, ze X. 


Prove that p is a metric on X, 
4. In R" let x, = (En, «--s Snx)- Show that 
Xn > X = Er, --y En) 
as k > 00 if and only if, for 1 < i <n, Sie > & 
5, In a metric space (X, p), Xn > x and yp, > y as n > 0. Prove that 
PCXny Yn) > P(X; ¥)- 
6. Show that, if p is a metric on X, then so is o given by 


P(X Y) 
1+p(x, y) 


a(x, y) = 
and that p, 7 are equivalent metrics. 
7. Prove that the metrics p, 7 on X are equivalent if there are constants 
A, # > 0 such that 
" Ap(x, ¥) < o(x, Y) < Mp(x, Y) 


for all x, y ¢ X. Give an example to show that the converse is false. 
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8. On R?, o and 7 are defined by 
o(x, y) = max (|x—yil, |X2—I2)), 70%) Y) = | —Yal + taal. 


Show that o and 7 are metrics which are equivalent to one another and to the 
usual metric p, 

Compare the sets of points x in R® given by p(x, a) < 1, (x, a) < 1,7(x, a) <1 
respectively. 


9. Denote by c the discrete metric on R' (p. 17, illustration (i)). Prove that o and 
the usual metric p on R' are not equivalent. 


10. Let C be the set of real functions continuous on the interval [0, 1] and define 


(ee Pf 8) = oe, |\f)—g@)|, 


ove) = (f' sere ax)’, 


1, 8) = f \f@)—g()| dx. 
(A function continuous on a closed interval is bounded and integrable.) Prove 
that o and 7 are metrics on C. Show also that, for all f, g € C, 
PL 8) = of, 8) > 7h 8). 
For n = 1, 2, ..., the functions f,, g, € C are defined by 
l-nx 0<x<n), n(l—nx) (0< x <n), 
aid = [ 0 (n> < x < 1). 


Sil) = { 


10) (i ex 1); 


Prove that the sequence (f,) converges in (C, 7) and in (C, 7), but not in (C, p); 
and that (g,) converges in (C, 7), but not in (C, p) or in (C, 7). 


11. Let (X, 01), ---» (Xn, Pn) be any metric spaces. Verify that metrics on 
Xx ... x X, are given by 


(x, y) = max {P4(x4, Ya)y ++» PnCXns Ynhs 
(x, Y) = VPI, Yd) +. + PRns YI 
a(x, Y) = Pr%ry Vi) + 02 + Pn(Xny Yds 


where x = (X1, -.-) Xn)y ¥ = Oy ++) Yn) and xi, 1 € X; (i = 1, ..., 2). Show also 
that 0), 0, 7 are all equivalent. 


2.2. Norms 

The theory of vector spaces is partly algebraic and partly analytical. 
We need only the most basic algebraic ideas and these are, no doubt, 
known to the reader. But, largely to fix notation and terminology, 
we formally define a vector space. 


Definition, Let V be a non-empty set and suppose that (i) to any two 
elements x, y of V there corresponds an element in V, called their sum, 
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which is denoted by x+y; and (ii) to any real number « and any x in V 
there corresponds an element in V, called the scalar product of « and 
x, which is denoted by ax. (Thus addition is a function on V x V into 
V and scalar multiplication is a function on R! x V into V.) Suppose 
also that the following conditions are satisfied. 

(1) x+y = y+x; 

(2) x+(y+z) = (x+y) +2; 

(3) there is an element 0 € V (the zero element) such that x+0 = x 
for allxeV; 

(4) to every element x €V there corresponds an element —x eV 
such that x+(—x) = 0; 

(5S) «(Bx) = (af)x; 

(6) Ix = x; 

(7) (@+A)x = ax+fx; 

(8) a(x+y) = ax+ay. 

Then V (together with the operations of addition and scalar multi- 
plication defined in V) is called a vector (or linear) space over R', or a 
real vector space. 

If the scalar product is formed with complex numbers « and the same 
properties (1)-(8) hold, then V is said to be a vector space over Z, or a 
complex vector space. 

The simplest example of a real vector space is R” with addition 
and scalar multiplication defined by 


(Xp «+9 Xn) + Vas e202 Yn) = Otro «+2 Xn +Yn)> 
OX y, 225 Xp) = (BX, «05 Uy), 


A more sophisticated example is Bla, b]; here f+g and af are defined 


by 
(f+9@ =fOt+s@), OO=%%) @<x< d). 


We shall assume the elementary algebraic properties of vector 
spaces. Some of these are given in exercise 2(b), 1. 


Definition. Let V be a vector space. The real valued function || .\| on V 
is called a norm on V, and V is called a normed vector space, if 
N1. ||x|| > 0 for all x € V and |\x|| = 0 if and only if x = 0; 
N2, |x+yl| < [|x| + ||| for all x, ye V; 
N3. |x|] = |a|||x|| for every number « and all xe V. 
It is easy to see that, in a normed vector space, a metric p may be 


defined by p(x, y) = ||x—-yI]. 
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In fact, the metrics in illustrations (ii)-(v) of §2.1 all arise from 
norms. For instance in R” the usual norm is given by 


|x|] = \GG+..- +n) 
and in Bla, 5] fl = SUP, |fCd|- 


However, a metric on a vector space need not be derivable from a 
norm (see exercise 2(4), 2). 

More specialized than normed vector spaces are inner product 
spaces. 


Definition. Let V be a complex normed vector space and suppose that, 
with every ordered pair (x, y) of elements in V there is associated a 
complex number, denoted by x.y, and that the following conditions are 
satisfied. 

ll. x.y = y.x for all x,y EV; 

12. (ax+fy).z = a(x.z)+A(y.z) for all numbers «,f and all 
X,Y, ZEV; 

13. x.x = ||x||? for all xe V. 

Then x.y is called the inner product of x and y and V is called a 
complex inner product space. 

If V is areal normed vector space, x.y is real and 11-13 hold, then V 
is called a real inner product space. Note that, in this case, I1 reduces 
tox.y = y.x. 

It is shown in exercise 2(4), 4 that no more than one inner product 
can be associated with a given norm. 

Once again R” provides the most obvious illustration. The inner 
product for the usual norm is defined by 


X.Y = Xt... + Xan 
The inequality (2.13) can now be written as 


x.y < [x] [yl 
and is a particular case of the following result. 
Theorem 2.21. (Cauchy’s inequality.) Jf V is a real or complex inner 


product space, then, for all x,y €V, 


|x-y] < [>t] [yI- 
Equality holds if and only if one of x, y isa scalar multiple of the other. 
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Proof. Since 0.y = 0 (see exercise 2(5), 6), we may assume that 


x + 0. Take p y.x 
— ee 
Then 0 < |Ax+yl? = (Ax+y).(Ax+y) 


\2l2|x|2+ AC.) +20-a)+lyl2 2 


x.y? ba 2 
be yl y ye 2 EPP yy, 
Ei 


Moreover ||/x+yl| = 0, ic. Ax+y = 0, if and only if y = ax for 
some number «. | 


I 


Exercises 2(6) 
1. Show that the following identities hold in a vector space: 
(i) Ox = 0; (ii) (—I)x = —x; (iii) a8 = 0; 
(iv) if x—y denotes x+(—y), then 
=Gty)= —x=y¥,  S—9) = y—x- 


2. Prove that the discrete metric « on R? (see illustration (i) of § 2.1) cannot be 
derived from a norm. 


3. Two norms on a vector space V are equivalent if they give rise to equivalent 
metrics. Prove that the norms ||.||, and ||.||, are equivalent if and only if there 
exist strictly positive constants A, “ such that 


All: < x2 < 4l xh, 
for all x € V. (Contrast exercise 2(a), 7.) 


4. Show that if, in a normed vector space, an inner product exists, then it is 
unique. 


5. The space T consists of the sequences x = (x, X2, ...) of complex numbers 
such that =|x,|* converges. Verify that p given by 


p(x, y) = (s Ixaaalt) (x, ye T) 


is a metric on T; that the metric arises from a norm; and that to this norm there 
corresponds the inner product 
a 
X.Y = VD Xn 
n=1 
6. Show that in an inner product space x.0=0.x=0. 
7. Prove that, if V is an inner product space, then, for all x, ye V, 
Jx+yl]?+lx—yl? = 2(]x]?+ [ly]. 


Hence give an example of a normed vector space which is not an inner product 
space. 
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8. The sequences (x,), (vn) in the normed vector space V converge to x,y 
respectively, and the numerical sequences («,), (f,) converge to «, f respectively. 


Show that 
de nXn t+ BnYn > 2X+ BY. 


Prove also that, if V possesses an inner product, then 
Xn-Yn > X-)e 


9. Alternative definition of inner product space. Let V be a complex (real) vector 
space and suppose that, with every ordered pair (x, y) of elements in V, there is 
associated a complex (real) number x.y such that I1, 12 are satisfied and 

13’, for all xe V, x.x > Oand x.x = Oif and only if x = 6. 

Show that ||x|| = (x.x) is a norm on V. 


2.3. Open and closed sets 


In this section we consider subsets of a fixed metric space (X, p). 
We shall use the symbol X¥ for the metric space as well as the set 
without reiterating that p is specified. 

Let ae X and let r be a positive real number. The set of points x 
such that p(a, x) < ris called the open ball with centre a and radius r; 
we shall denote it by B(a;r). In R', B(a;r) is the open interval 
(a—r, a+r). In R® and in Z an open ball is usually called an open 
disc. 


Definition. Given a subset E of X (which may be X itself), the point 
céX is said to be a limit point of E if, for every € > 0, there is an 
x €E such that 0</(cx) <6, 


i.e. B(c; €)—{c} contains a point of E. 

A limit point c of E can also be defined by either of the following 
two conditions: 

(i) Every open ball B(c; €) contains infinitely many points of E. 

(ii) There is a sequence of points x, ¢E such that x, +c and 
X, > ¢ aS n>. 

It is clear that a point c with properties (i) or (ii) is a limit point of E. 
Conversely, if c is a limit point of E, then, for every 7, there is a point 
x, € E such that 0 < plc, Xp) < Ifn 


and so (ii) is satisfied. Also (ii) implies (i). 

The conditions (i) or (ii) show that a finite set cannot have a limit 
point. An infinite set may or may not have a limit point. For example 
the subset {1, 2, 3, ...} of R! has no limit point. 

It is important to note that a limit point of a set E may or may not 
belong to E. For instance if, in R', Eis the interval (0, 1), then every 
point in the interval [0, 1] is a limit point of E. 
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A point c of E is said to be an isolated point of E if it is not a limit 
point of E. Thus, if c is an isolated point of E, there is a 6 > 0 such 
that B(c; 6) contains no point of E other than c. 


Definition. Given a set E < X, the point c € Eis said to be an interior 
point of E if there is a 6 > 0 such that B(c; 6) < E. 


Illustrations 


(i) All points of an open ball B(a; r) are interior points of B(a; r). For suppose 
that c € B(a; r), so that p(a, c) = s < r. If 6 = r—s and p(c, x) < 4, then 


pla, x) < pla, c)+plc,x)< st+é=r 


and so xe B(a;r). Therefore B(c; 6) < B(a;r), i.e. c is an interior point of 
B(a; r). 

(ii) X = RY. 

Let E = (0, 1). The set of limit points of E is [0,1]; the set of interior points 
of E is (0, 1). 

Let E be the set of rational points of R'. Every point of R? is a limit point of E. 
E has no interior points. 

ii) X = Z. 

Let E be the annulus consisting of the points z such that 1 < |z| < 2. The set 
of limit points is the set of z such that 1 < |z| < 2. The set of interior points 
is E, 

Let E be the set of points x+ iy such that y = —1 and 0 < x < 1. The set of 
limit points is E. There are no interior points. 


When the space X has no isolated points (as is the case with R” 
and Z) then an interior point of a subset E of X is also a limit point 
of E. But if X is, for instance, the space consisting of all the integers 
(and p is the usual metric in R?), then every subset E of X is without 
limit points although all the points of E are interior points of E. 


Definition. (i) A set F in X is said to be closed if F contains all its 
limit points. 

(ii) A set G in X is said to be open if every point of G is an interior 
point of G. 


Illustrations 

(i) Every open ball in a metric space is open. A set {x|p(a, x) < r} is closed 
(see exercise 2(c), 2) and is consequently called the closed ball with centre a and 
radius r. 

Any set without limit points is closed; in particular, every finite set is closed. 

(ii) In R", every open interval is open and every closed interval is closed. 

(iii) In R', the interval [0, 1) is neither open nor closed; the set of rational 
points is neither open nor closed. 

(iv) In Z, the annulus defined by 1 < |z| < 2 is open; the real axis (im z = 0) 
is closed; the set of points z = (1+i)/n (m = 1, 2, ...) is neither open nor closed. 
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(v) Let (C[a, 5], p) be the metric space of real functions continuous (and so 
bounded) on the interval [a, 5], in which 
Pf.g) = sup |f(X)—g)- 


a<z<b 
Then the set E, of f such that 
inf f(x) >0 
a<z<b 
is open and the set E, of f such that 
f@=1 
is closed. 

(vi) In any metric space the empty set and the whole space are both open and 
closed. In R® and Z these are the only sets that are both open and closed (theorem 
3.32, corollary). In an arbitrary metric space there may be others. For instance 
in the space of integers (with the usual metric of R*) every set is both open and 
closed. The question is taken up again in §3.3. 

(vii) The property of being open or closed (or neither) is not intrinsic to a 
given set E; it is relative to the set X¥ of which E is regarded as a subset and the 
metric p with which X is endowed. For instance [0, 1) is neither open nor closed 
as a subset of R' equipped with the usual metric, but [0, 1) is closed as a subset 
of (—1, 1) with the same metric; and as a subset of (R', 7), where o is the discrete 
metric, [0, 1) is both open and closed. 

A convenient characterization of closed sets is embodied in the 


following result. 


Theorem 2.31. A necessary and sufficient condition for the set F to be 
closed is that, whenever (x,) is a convergent sequence of points in F, 
lim x, € F. 
n> 

Proof. First suppose that F is closed and that x, +x, where 
x, € F for every n. If x,, = x for all sufficiently large n, then, a fortiori, 
x € F; otherwise x is a limit point of F and again x € F. 

Next, let F have the property described in the theorem. If F has no 
limit points, then F is closed. If F has a limit point x, then there is a 
sequence (x,) of points in F such that x, > x, and so xe F. | 


Theorem 2.32. (i) The set G in X is open if and only if G' (= X—G) 
is closed. 
(ii) The set F in X is closed if and only if F’ (= X—F) is open. 


Proof. We need only show that (a) if G is open, then G’ is closed 
and (6) if F is closed, then F’ is open. 

(a) Let G be open. If G’ has no limit points, then G’ is closed. If G’ 
has a limit point c, then every open ball B(c; €) contains points of G’. 
Hence c cannot be an interior point of G and, since G is open, c ¢ G. 
Thus c€G’. We have therefore shown that G’ contains all its limit 
points. 
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(b) Let F be closed. If F’ is empty, then F’ is open. If F’ is not 
empty, let x be any point of F’. Since Fis closed and x ¢ F, it follows 
that x is not a limit point of F. Hence there is a B(x; 6) free of points 
of F, i.e. there is a B(x; 6) < F’. Thus the arbitrary point x of F’ is an 
interior point of F’. | 


We have stressed the fact that a given set is open or closed (or 
neither) only with respect to the metric space in which it is embedded. 
It is therefore of interest to note that, if p and o are equivalent metrics 
on X, then the metric spaces (X, p) and (X, a) have the same open 
and the same closed sets. This follows easily from the last two 
theorems. The converse also holds. 

The next theorem concerns collections of open or closed sets. 
These collections may be finite or infinite and need not be countable. 


Theorem 2.33. (i) The union of any collection of open sets is open. 
(ii) The intersection of any collection of closed sets is closed. 


Proof. (i) Let Y be a collection of open sets G. If xe U G, then 
Geg 


there is a member of Y, say G*, such that x € G*. Since G* is open, 
x is an interior point of G*, i.e. there is a 6 such that 


B(x; 8) < G* 
and so also B(x; 6) UG. 


Gg 


Hence x is an interior point of U G. This shows that U G is open. 
Geg Geg 


(ii) Let F be a collection of closed sets F. We could show directly 


that ( F contains all its limit points; but, to illustrate the use of 
FeF 


complements in proving ‘dual’ results for open and closed sets, we 
use (i) as follows. 
Since F’ is open, whenever Fe F, by (i), 
(N F'= UF 
FeF 


FeF 


is open. Hence, by theorem 2.32, ( Fis closed. | 
FeF 


Theorem 2.34. (i) The intersection of a finite collection of open sets 
is open. ’ 

(ii) The union of a finite collection of closed sets is closed. 

The proof is left to the reader. 
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Exercise. Give examples of (i) a sequence of open sets whose intersection is not 
open and (ii) a sequence of closed sets whose union is not closed. 


Let ( Y, ) be a subspace of the metric space (X, p). Then (Y, o) has 
open and closed sets and, although a set which is open (closed) in Y 
is, of course, generally not open (closed) in X, the relationship be- 
tween open and closed sets in X and in ¥ is very simple. 


Theorem 2.35. Let (Y, 7c) be a metric subspace of the metric space 
(X, p). Then a set is open in (Y, 0) if and only if it is of the form 
Y n G, where G is open in (X, p). A similar result holds for closed 
sets. 


Proof. First, if G is open in X, then clearly every point of Y n G 
is an interior point of Y n Gin Y. 

Next, let E be open in Y. Then, for every x € E we can find a 6, 
such that ye E whenever ye Y and o(x, y) < 6,. If now B(x; 6,) 
denotes an open ball in X, the set 

G= U Be; 8) 


2eE 
is open in YandE= YG. 
The result for closed sets may be deduced by the method of taking 
complements. | 


Corollary. If Y is open in X, then a subset of Y is open in Y if and only 
if it is open in X. If Y is closed in X, then a subset of Y is closed in Y 
if and only if it is closed in X. 


Definition. Let E be any subset of X. 

(i) The interior of E, denoted by E°, is the set of interior points of E. 

(ii) The closure of E, denoted by E, is the union of E and the set of 
limit points of E. 

Thus E is the set of x such that every B(x; €) contains at least one 
point of E or, equivalently, x ¢ £ if and only if x is the limit of a 
sequence of points in E. 

For alternative definitions of the notions of interior and closure 
see exercise 2(c), 6. 


Theorem 2.36. For any set E in X, E° is open and E is closed. 


Proof. If E° is empty, it is open. If E° is not empty, let x be any 
point of E°. Then there is a B(x; 6) ¢ E. Every ye B(x; 6) is an 
interior point of B(x; 6) and so of E. Hence B(x; 6) < E° and there- 
fore x is an interior point of E°. 
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It may be shown directly that E is closed. The result also follows 
from the identity (BE) = (EY 


which is easily proved. (See exercise 2(c), 7.) | 


Open and closed sets could also have been defined in terms of 
interiors and closures: G is open if and only if G° = G; Fis closed if 
and only if F = F. 


Definition. A frontier point of a set E in X is a point c such that 
every open ball B(c; €) contains at least one point of E and at least one 
point of E’. The set of all frontier points of E is called the frontier of E 
and is denoted by fr E. 

Clearly E and E’ have the same frontier. 

Since a frontier point of E is a point of E which is a limit point of 
E’ ora point of E’ which is a limit point of £, it follows that 


fr E = E-E’. (2.31) 
Mllustrations 
(i) Let E be the interval [0, 1) in R'. Then E° = (0, 1), E = [0, 1] and frE = 
{0, 1}. 


(ii) Let (X,) be the space of integers with the metric induced by R’. If 
E = B(c; 1) = {c}, then E° = E = E. Note that E is not the closed ball 


{xlp(x, e) < 1} = fe-1,¢, c+ 1}. 


Exercises 2(c) 
1. Show that every infinite set ¥ may be equipped with a metric p which is such 
that X has a limit point in CX, p). 
2. Prove that, in any metric space (X, p), the closed ball {x|p(a, x) < r}is closed. 
3. Prove that a bounded, closed set of real numbers contains its supremum and 
infimum. 
4. Let E be an arbitrary set in a metric space. Show that the set E* of limit points 
of E is closed. 


5. Show that in R" with the usual metric any collection of disjoint open sets is 
countable. Is this true for an arbitrary metric space? 


6. (i) Show that E° is the union of all open sets contained in E and so is the 
‘largest’ open set contained in E. 

(ii) Show that £ is the intersection of all closed sets containing E and so is the 
‘smallest’ closed set containing E. 


7. Prove that, for any subset E of X, 

E°ufr Eu(EY = X 
and (EY = (EY. 
(The set (E’)° is called the exterior of E.) 
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8. Prove that fr E= EnE’ 
and that fr E is closed. 
9. (i) Prove that E,U...UE, = E,v...UE, 
but that, for an infinite collection & of sets E, generally the relation 
UE> UE 
Eeé Ec& 
only holds. 
(ii) Prove that, for any collection & of sets E, 
NECNE 
Ecé Ecé 


Construct an example to show that identity need not hold even for a finite 
collection. 
(iii) Deduce the results for interiors corresponding to (i) and (ii). 


10. The metric spaces (X, p), (X, 7) have equivalent metrics. Show that every 
subset E of X has the same limit points and interior points in (X, p) and (X, ¢). 


11. If E is a set in a metric space and the set D is such that 
DcEcD, 


then D is said to be dense in E. (For instance the set of rational numbers is dense 
in R*.) Show that, if C is dense in D and D is dense in E, then C is dense in E. 


NOTES ON CHAPTER 2 


§2.1. The idea of a metric space is due to M. Fréchet. In his doctoral thesis, 
published in 1906, he examined various sets of axioms for a metric. The set 
M1-—M3 is the one which experience showed to be the most fruitful. 

The inequality (2.12), which is equivalent to the triangle inequality for the 
usual metric on R", is a particular case of Minkowski’s inequality 


n 1fr n 1/r n 1/r 
(3 (a.+b,’) < (3 a’) +(3 wi) 

i=1 \i=1 i=1 
in which a;, b; > 0(i = 1, ... n) andr > 1. (In (2.12) the a;, b; may be negative, 
but the step from non-negative a;, b; to arbitrary ones is trivial.) The inequality 
(2.13), which we call Cauchy’s inequality in theorem 2.21, is also known as 
Schwarz’s inequality (or even the Cauchy-Schwarz inequality). It is a particular 
case of HGlder’s inequality. 


n n Ip /n 1/q 
3 abs < (3 at)" (Eat), 
i-1 i=1 i=1 


where a,b; > 0 (i= 1,...,”), p > 1 and p-++q— = 1. Both Hdlder’s and 
Minkowski’s inequalities may be generalized in a variety of ways. (See Hardy, 
Littlewood and Polya, Inequalities.) 
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CONTINUOUS FUNCTIONS ON 
METRIC SPACES 


3.1. Limits 


The notion of continuity is based on that of a limit and we first 
define the limit of a function whose domain and range lie in arbitrary 
metric spaces. 


Definition. Let (X, p) and (Y, 7) be metric spaces. Let f be a function 
with domain E < X and with range in Y. Suppose also that x, is a 
limit point of E and y,€ Y. We then say 

T(x) > Yo aS Xx>Xq or lim f(x) = Yo 


if, given € > 0, there is a 6 > 0 such that 
o(f(x), ¥o) < € whenever x E and 0 < p(x, Xo) < 8. 


Notes. (i) It is irrelevant whether xp belongs to the domain E of f 
or not. 

(ii) When ¥ = Y = R' (or Z) the above definition reduces to the 
standard definition of the limit of a real (or complex) function. 


Exercise. Show that a function cannot converge at a point to more than one 
limit. 
Illustrations 


(i) X= Y= 
(a) With E = Rt, lim x* = x5 (k = 1,2,..). 


(6) With E = R— (0, ue x sin (1/x) = 0, he sin (1/x) does not exist. 
(c) Let E be the set of 1 rauonal numbers Ax et f be defined on E by the 


acs fpla) = 1a 


when p, q are coprime integers and q > 1. We shall show that, for every c € R’, 
lim f(x) = 0. 
ae 

Given ¢ > 0, let g) be an integer such that 1/g. < €. Denote by Q, the set of 
rational numbers p/q with g < go. We note that, in any finite interval, there is 
only a finite number of members of Qo. Hence there is a 6 > 0 such that the 
intervals (c—6,c) and (c,c+6) contain no members of Qy. It follows that, 
whenever 0 < |c—p/q| < 4, 
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Gi) X = R*, E= R°—{(0,0)}, Y= R’. 


Let g, be given by : 


&(x, y) = rer 
x 
Then lex, »)| = |x| Pet bs |x| 
and lim = g,(x;y) = 0. 
(x, v)>(0, 0) : 
a 
Let g, be given b =——. 
8 be given by 82(x, y) Pore) 
Then lim _ga(x, y) does not exist. For, if y = mx, we have (for all x + 0), 
(x, v)>(0, 0) 
RO the ee 
big ~ x2 mix? 1 +m?” 


and so g, takes all values between 0 and 1 in any annulus 0 < x*+y* < &, 
(iii) Let E = X¥ = Y = C[0, 1] (the set of real functions continuous on [0, 1). 
The metric p is, as is usual on C[0, 1], given by 


Pps, 2) = sup |9x(t)—92(0)|. 
0<t<1 
The function A from C[0, 1] to C[0, 1] is given by h(¢) = ¥, where 
v0 = [ deorar 


If, for instance, #, is given by d(t) = ¢?, ea A(P) = Wo, where yro(t) = 42°. 
For, if p(o, 6) < ¢, then, forO < 4 <1, “ 


ve ['6e ar| . | [ers ar| 
< [iir-deniar <e 


Wrol)-¥@] = 


and therefore p(W/o, /) < €. 

A sequence 4;, da, a3 ... may be regarded as a function on the set 
{1, 4, 4, ...}. It follows that the notion of a sequential limit may 
be expressed by means of the notion of a functional limit. What is 
less obvious, and more interesting, is that the opposite statement is 
also true. 


Theorem 3.1. Let (X,p) and (Y,o) be metric spaces. Let f be a 

function with domain E < X and with range in Y and suppose that xo 
is a limit point of E. Then f(x) > yo as X > Xo if and only if, for every 
sequence (x,) in E—{xo} such that X_ > Xo; f(Xn) > Yo asin > ©. 


Proof. (i) Suppose that f(x) > yo as x > Xo. Then, given ¢ > 0, 
there is a d > 0 such that 


o(f(x), Yo) < € whenever x € E and 0 < p(x, x9) < 3. 
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Now, if (x,) is any sequence in E— {xo} such that x, > Xo, there is an 
integer m) such that 

0 < p(x, %) <6 for n> Mm. 


Therefore o(f(xn), Yo) < € for n> Mm, 
ie. S(X%n) >Yo AS N> OO. 


(ii) Suppose that, whenever (x,) is in E—{xo} and x, > Xo, 
I&%n) > Yo- 

If f(x) + yo as X > Xo, then there is an ¢ > 0 with the property 
that there is no 6 > 0 such that o(f(x), yo) < € whenever x ¢ E and 
0 < p(x, Xo) < 4. Therefore, given any n, there is an x, € E such that 


0 < p(Xn, Xo) < [fn and o(f(x,),¥0) > € 


Thus there is a sequence (x,) in E—{x} such that x, > xX) and 
F(x,) +> Yo. This contradicts our original hypothesis and so f(x) > yo 
as X > Xp. | 


For functions with values in a normed vector space V there is, as 
might be expected, an algebra of limits. Let f, g be such functions 
defined on a subset E of X. Also suppose that £ has a limit point xo 
pecs SX) + Yo, B(x) > 2% AS X> Xo. 

When ¢, y are real or complex valued functions on E and 


(x)>a, YxX)>R as x>X 


then A(X) SO) + VO) B(x) > a+ feo. G.11) 
If V possesses an inner product, then also 

I(x) .8(%) > Yo-205 (3.12) 
and if V is R' or Z, F(X) g(x) > yolZo (3.13) 


provided that z) + 0. 

These results may be proved directly or they may be deduced, by 
means of theorem 3.1, from the corresponding results on sequences 
(exercise 2(5), 8). 

Exercises 3(a) 
1. The real valued function fon R*— {(0, 0)} is defined by 
xy 
f(x, ¥) = rer 


Show that lim f(x, y) does not exist. 
(z, y)—>(0, 0) 
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2. Let (X, p), (¥, 7) be metric spaces. Let f be a function with domain E < X 
and with range in Y, and suppose that x, is a limit point of E. Show that, if 


lim f(x,) exists for every sequence (x,) in E—{x9} such that x, > Xo, then 
no 


lim f(x) exists. 
r-Zy 


3. Let (X, p), (Y, ©) be metric spaces, and let E be a subset of X, x, a limit point 
of E, yy a point of Y. Show that, if the function f: E- Y is such that f(x) > yo 
as x > Xo, then y, € f(E); and that if, in addition, fis injective, then yp is a limit 
point of f(E). 


4. Let (X, p), (Y, 0), (W,7) be metric spaces and let D, E be subsets of X, Y 
respectively. Leth = go f: D > W be the composition of the functions f:D > Y, 
where f(D) ¢ E, and g: E> W. Also (i) xp is a limit point of D and f(x) > yo 
as x > X9; (ii) yo is a limit point of E and g(y) > wo as y > yo. Show that, when f 
is injective (so that, by 3, yo is automatically a limit point of £), then h(x) > wo 
as x > x. Construct an example in which h(x) +> wo. 


5. Prove that the statements (3.11)—(3.13) hold under the conditions given at the 
end of the section. 


3.2. Continuous functions 


The definition of continuity which we shall now give is a natural 
generalization of the concept familiar in elementary analysis. 


Definition. Let (X, p) and (Y, o) be metric spaces. Then the function 
f: X > ¥ is said to be continuous at the point xo of X if, givene > 0, 
there isa é > 0 such that 


o( f(x), f(%0)) < € whenever p(x, X) < 6 
(or f(B(xo; 8) = BF); €)). 


If f is continuous at all points of a set, it is said to be continuous on 
that set. 
The definition implies that f is continuous at a limit point x) of 


= Me ead “an -: 


and that fis continuous at all isolated points of X (for if x) is an 
isolated point and 4 is sufficiently small, the only point x such that 
A(X, Xo) < O is Xp itself). 

Let f be a function whose domain is a subset XY, of a metric space 
(X, p). When considering the limits of f we are interested in the limit 
points of X, and these need not belong to X,. However, for questions 
of continuity, only the points of the domain X, of f are relevant. 
Since X,, endowed with the metric induced by (X, p), is itself a 
metric space, it is therefore simplest in this context to treat X, as the 
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fundamental space. This is, in fact, what we did in the definition of 
continuity. 
Mlustrations. The function f of illustration (i)(c) on p. 32 whose domain is the 


set of rational numbers, is discontinuous everywhere. If f,, with domain R? is 


ey f(x) when x is rational, 


ix) = { 


0 when x is irrational, 


then /, is continuous at all irrational points and discontinuous at all rational 
points. 
The function A: C[0, 1] > C[0, 1] of illustration (iii) on p. 33 is continuous 
on C[0, 1]. This follows from the inequality 
ChCP), Aba) < P(pr» $2) 


which holds for all ¢,, 42 of C[0, 1]. 
Let (X, p) be any metric space, let a be a fixed point of ¥ and let the function 

g: X > R' be defined by the equation 

a(x) = pla, x). 
Since P(Q, X1)— P(A, X2) < PC%2, ¥1) 
and P(A, X2)— P(A, X1) < PCr, X2)s 

leGa)—gG)| = |0(@, x1)—P(@, >2)| < Pr, 2) 

for all x,, x, in X. Hence g is continuous on X. 


Algebraic operations on continuous functions with values in a 
normed vector space again yield continuous functions. If the functions 
f,g: XV and the functions ¢, y: X > R' (or Z) are continuous 
at Xp, then ¢f+yg is continuous at x9; so is f.g if V is an inner 
product space, and f/g is continuous at Xp if Vis R! or Zand g(x) + 0. 
All this is obvious when x, is an isolated point of X and otherwise 
follows from the corresponding results on limits. In the next theorem 
we return to functions with arbitrary ranges. The result contrasts 
with exercise 3(a), 4. 


Theorem 3.21. Let (X,p), (Y,o), (W,7) be metric spaces and let 
h = gof: X > W be the composition of the functions f: X + Y and 
g: Y>W. If f is continuous at Xx, and g is continuous at yo = f(X»), 
then h is continuous at Xo. 


Proof. Given ¢, there is an 7 such that 


1(g(y), g(%)) < € whenever o(y, Yo) < 7- 
There is now a 6 such that 


o(f(x), f(%o)) < 9 whenever p(x, Xo) < 6 
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and so 6 is also such that 
1(h(x), h(x9)) < € whenever p(x, X%) < 6. | 


It is important to note that the inverse function of a bijective 
continuous function is generally not continuous. A simple example 
is the function f with domain X = [0, 1) u [2, 3] and range Y = [0, 2] 
defined by oe forO<x< 1, 
x-1 for2<x< 3. 


If Xand Y have the metrics induced by R’, then fis continuous on X, 
However f-, which is given by 


y for0 < y <1, 


=f 
‘alas 


TTo)y'= { 
yt+l1 forl<y<2, 
is discontinuous at the point 1. For other examples see exercises 
3(b), 4 and 5. 
The concept of continuity can be formulated in a variety of ways. 
We shall next consider equivalent definitions, first for continuity at 
a point and then for continuity on the domain of the function. 


Theorem 3.22. Let (X,p) and (Y,c) be metric spaces. A necessary 
and sufficient condition for the function f: X > Y¥ to be continuous at 
the point Xp is that x, > Xo implies f(x,) >f(X0). 

The proof is similar to that of theorem 3.1. The theorem may also 
be deduced from theorem 3.1, but slight complications arise, since 
members of the sequence (x,,) may now be Xp. 

Theorem 3.22 shows that the introduction of equivalent metrics 
in the domain or the range of a function does not affect the property 
of continuity: if p,p, are equivalent metrics on X and ¢,o, are 
equivalent metrics on Y, and if f: X > Y is continuous at x) with 
respect to p and a, then fis also continuous at x» with respect to p, 
and o}. 


Theorem 3.23. Let (X,p) and (Y,0) be metric spaces. Each of the 
following conditions is necessary and sufficient for the function 
f: X > ¥ to be continuous on X: 

(i) Whenever G is open in Y, then f-\(G) is open in X. 

(ii) Whenever F is closed in Y, then fF) is closed in X. 


Proof. (i) First suppose that fis continuous on X and that the set 
G is open in Y. 
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If the set f-(G) is empty then it is also open. If f(G) is not empty, 
let x) be any one of its points. Then f(x9) € G and, since G is open, 
there is an € such that 

yeG whenever o(y, f(%)) < € 
But, since fis continuous at x, there is a 6 such that 
o(f(x),f(%)) < € whenever p(x, X) < 6. 

Hence S(x)EG whenever p(x, X%) < 6, 
ie. xef-(G) whenever p(x, Xo) < 6. 


This shows that x, is an interior point of f-(G). It follows that 
f-(G) is open in X. 
Next suppose that, whenever Gis open in Y, then f-(G) is open in X. 
Let x) be any point of X and take any positive ¢. The open ball 
B(f(X); €) is open in Y and so, by hypothesis, the set f{B( f(x); ©} 
is open in X. This set also contains x, and therefore there is a d > 0 


such that | < F-1(B(f(x:);6)} whenever p(x, x) <6, 
ice. SC) € Bf); 6) whenever p(x, x9) < 8, 
ie, of), fla)) < € whenever p(x, x0) < 6. 


Thus f is continuous at x) and so on X. 
(ii) This part follows from (i) by the method of complements since, 
if E is any subset of Y, 


FE) NFME) = @ and f(E) uv fXE) = X. | 


In the last theorem the inverse images may not be replaced by direct 
images. It is not true that f(S) is open (closed) in Y whenever S is open 
(closed) in X. The function defined on p. 37 will illustrate this 
(exercise 3(b), 6) but it is instructive to employ also more common- 
place examples. For instance the function f with domain R' and 

ie 
range R! given by FG) = xx—1)(e=2) 


maps the open interval (0, 1) onto (0, 3]. Next, let g, with domain 
(— ©, 00) and range [—4, 4] be defined by 


r= Es 


This function maps the closed interval [1, oo) on the interval (0, 4] 
which is not closed in [—4, 4]. 
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We have previously mentioned that a bijective continuous function 
t:(X p) > (¥, @) need not be such that f: (¥, 7) > (X, p) is con- 
tinuous. When f~ is continuous, fis called a homeomorphism. (Note 
that then f- is also a homeomorphism.) Two metric spaces are said 
to be homeomorphic if there exists a homeomorphism on one into 
the other. If f:(X,p)~>(Y¥,¢) is a homeomorphism, then, by 
theorem 3.23, f maps open (closed) sets in X into open (closed) sets 
in Y and there is a bijection between the open (respectively closed) 
sets in the two spaces. 

A bijective function f: (X, p) > (Y, o) such that 


of (x1), F(%2)) = PO» X2) 


for all x;, x, € X is called an isometry. It is plain that an isometry 
is a homeomorphism. Two metric spaces are called isometric if there 
exists an isometry on one into the other. Such spaces have identical 
metric properties although their elements may be of entirely different 
kinds. For instance R? is isometric with the subspace A of C[0, 1] 
consisting of the functions ¢, (— 00 < A < o) defined by 


$(x) =Ax O<x< 1). 


Another example of an isometric pair is provided by R?, Z. 


Linear functions. We briefly consider a class of functions which 
plays an important part in modern analysis. 


Definition. Let V, W be two real (complex) normed vector spaces. A 
function f: V > W is called linear if 
S(GaX1 + %a%2) = f(y) + Mf) 
for all x1, X,€ V and all real (complex) numbers a, %. 
Clearly f(@) = 9, where the letter @ on the left stands for the zero 
element in V and that on the right for the zero element in W. (It is 


not customary to use distinctive notations for the zero element and 
the norm in the two spaces.) 


Illustrations 
(1) The function f: C{a, 6] > R' defined by the relation 


» 
KO) = [sear Ge Cla, bv 
a 
is linear. 
(2) The reader is probably acquainted with linear functions on one Euclidean 
space into another. We shall use three properties of these functions which are 
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proved in most books on linear algebra. (See, for instance, L. Mirsky, Jntro- 
duction to Linear Algebra, chapters IV and V.) 
(i) The function f: R™ + R” is linear if and only if it is of the form 


SIMs 0049 Xm) = Vy oor Ynds 


where Yu = Ay Xt... + AimXms 
(3.21) 


Yn = AnyXy+ «6+ AnmXm. 


(C0) 


The nx m matrix (a;,) is said to represent f. 

(ii) If the linear functions f: R" > R" and g: R" > R® have matrices A, B, 
then the linear function go f: R" + R? is represented by the matrix BA. 

(iii) Let f: R" > R" be a linear function with matrix A. Then / is injective if 
and only if > mand A has (maximum) rank m. Also fis surjective (i.e. the range 
of fis the whole of R") if and only if n < mand A has (maximum) rank n. Thus, 
a necessary and sufficient condition for f to be bijective (so that f-! exists and is 
again a linear function) is that m = n and A has maximum rank, i.e. det A + 0. 
When / is bijective, f-! has matrix A. 


It is easy to see that a linear function on R” into R” is continuous 
at all points of its domain (see exercise 3(b), 8). A consequence of 
the theorem below is that any linear function either is everywhere 
continuous or is nowhere continuous. 


Theorem 3.24, Let V, W be normed vector spaces. If the function 
Jf: V + Wis linear, then the following three statements are equivalent. 
(i) fis continuous on V. 
(ii) There is a point xX, € V at which f is continuous. 
(iii) || f(@)||/||x|| is bounded for x = V— {6}. 


Proof. (ii) + (i). Take any ¢ > 0. Since f is continuous at x, 
there is a 6 > 0 such that ||x—.x,|| < 4 implies || f(x) —f(%)|| < ¢. 

Let c be any point of V and take any x such that ||x—cl| < 6. Then 
||(x-—c+Xx)—Xx|| < 6 and therefore || f(x—c+x)—f(x0)|| < €, ie. 
fC) —f(0)|| < €. Thus f is continuous at c. 

(i) > (ii). Suppose that ||f(x)|]/|x|| is not bounded. Then, given 
any integer 7, there is a point x, € V—{9} such that || f(x,,)|\/||x,\| >”. 
If vy = (7|xnl|)*x, then ||v,|| = 1/n and 


Le = Gall 5 4, 


nllxnll 
Hence fis not continuous at 4. 
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(ii) > Gi). Let N = sup || f(x)|\/||x||. Since f(@) = 9, the inequality 
IFO) < Nl 
shows that fis continuous at . | 
Given the normed vector spaces V, W, denote by L(V, W) the set 
of continuous linear functions on V into W. With the usual interpre- 


tation of addition and scalar multiplication of vector valued functions, 
L(V, W) is a vector space. Moreover it is easily verified that the 


equation TA = sup Lelia (FeL,™) = B.22) 


defines a norm on L(V, W). 
Notes. (i) In (3.22) the symbol ||.|| is used in three different senses. 


Gi) LF = sup 709). 
(iii) For all xe V, 


[FCO < [LF [>t 
Theorem 3.25. If (a;;) is the matrix of the function fe L(R™,R"), then 
t 
es la;i| < ||fl| < (e3 x a) ; (3.23) 


Proof. Let x be any point of R™ and let y = f(x). Applying 
Cauchy’s inequality (2.13) to (3.21) we have 


yt... ty, < (3 ats) (= x) tit (3 at.) (>) 
i bt? < (3 3 at) bate 


This proves the right-hand inequality in (3.23). 
Next, if |a,,| = max |a;;|, let x* be the vector with pth component 1 
43 


and all other components 0. Then ||x*|| = 1 and 
IFG*)| = Gipt.. + Gny)t > |agp|- | 


Exercises 3(b) 
1. Prove the second part of theorem 3.23 without using the first part. 
2. Let (X, p), (Y, ©) be metric spaces. Show that f: X + Y is continuous at the 
point x, if and only if, given any open set N in Y which contains f(x), there is 
an open set M in X such that x) ¢ M and f(M) © N. 
3. Construct a function f on a metric space (X, p) which is discontinuous at all 


points of a dense subset E of X, but is such that the restriction of f to E is con- 
tinuous on E, 
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4. Let X, Y be similar, infinite sets and suppose that their metrics p, ¢ are such 
that (X, p) has no limit points while (Y, 7) has at least one limit point. Show that, 
if the function f: X + Y is bijective, then f is continuous on X, but f- is not 
continuous on Y. (Thus (X, p), (Y, 7) are not homeomorphic.) Give an example 
of such a function f. 


5. The metric spaces (X, p), (X, 7) have the same underlying set X. Let 
1: (X, p) + (X, 0) 
be the identity function given by J(x) = x. Show that J is a homeomorphism 


if and only if p and o are equivalent metrics. Give an example to show that, when 
P, & are not equivalent, J may be continuous without /-! being continuous. 


6. Let f be the function with domain X = [0, 1) U[2, 3] and range Y = [0, 2] 
defined on p. 37. Find a set G open in X and a set F closed in X such that f(G) 
is not open in Y and f(F) is not closed in Y. 


7. The function g with domain (— 09, 00) and range [0, 0) is given by 

a(x) = (x—1)*e*, 
Show that there are open (closed) sets in (— 0, 0) which are mapped by g into 
sets that are not open (closed) in [0, 0). 


8. Let (X, p) be a metric space and let f,, ..., f, be functions on X to R'. The 
function f = (f,, ...,f,): X > R” is given by 


LQ) = (AQ), ---» fn). 


Prove that fis continuous at the point x, € Xifand only if, f, ..., f, are continuous 
at xo. 

Hence, or otherwise, show that every linear function on R” into R” is every- 
where continuous. 


9. Let (X, p), (Y, 7), (W, 7) be metric spaces. To define continuity of a function 
on Xx Y into W we use one of the equivalent metrics on Xx Y of exercise 
2(@), 11. 
Given f: Xx Y> W and x, € X, yoe Y, define the functions g on X and 
hon W by 
8(x) = f(x, ¥o) (EX), hO) =f, ¥) WEY). 


Show that, if f is continuous at (x9, yo), then g, A are continuous at Xo, Yo Te- 
spectively. Construct an example to show that g, h may be continuous at x9, Yo 
respectively without f being continuous at (xo, Vo). 


10. Let D be the vector space of real differentiable functions on the interval [0, 1] 
and define the norm on D by 


Id] = sup |p| @e D). 
O<r<1 


Let f: D > R! be the linear function defined by 
Sf) = $0) (be D). 


Show that fis not continuous. 
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11. The linear function f: R" > R’ is given by 
: SX vy Xn) = Xt 00 Fn Xn 
Find |/|. 
12. Let U, V, W be normed vector spaces and let f: U + V, g: V-> W be con- 
tinuous linear functions. Show that 
leofl < lellsi. 


Deduce that, if fhas a continuous inverse /-1, then 


IFIAAl > 1. 


Give an example of a linear function f such that 


IFFT > 1. 


3.3. Connected metric spaces 


In the classical account of continuity the more striking results, 
such as those relating to bounds and intermediate values are proved 
for continuous functions defined on finite closed intervals. These 
results do not hold for arbitrary continuous functions, but they can 
be regained by suitably restricting the domain. The theme of the 
remainder of this chapter is the relation between the structure of a 
metric space and the properties of the continuous functions defined 
on it. 

We remarked in chapter 2 that there exist metric spaces (X, p) in 
which sets other than @ and X are both open and closed. A space 
in which there are no such sets is called connected. Since a set is 
both open and closed if and only if its complement is both closed 
and open, the condition for a space not to be connected is that it is 
the union of two non-empty, disjoint open sets. The notion of con- 
nectedness can also be applied to subsets of a space. The subset E of 
X is said to be connected if the metric space (£, 7) is connected, 
where o@ is the metric induced by (X, p). In view of theorem 2.35 we 
may therefore formulate the definition of connectedness in the 
following way. 


Definition. Let (X, p) be a metric space. 

(i) The open subset G of X (which may be X itself) is said to be 
connected if there do not exist two non-empty open sets Gy, Gy such 
that GiNG,= 8 and G,UG, =. 

(ii) An arbitrary subset E of X is said to be connected if there do not 
exist open sets G1, Gy, such that 


GiNE+ 2, GNE+ 2, G,NGnE= 2, GUG RE. 
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It is clear that part (i) is a particular case of part (ii). Note that, 
by definition, the empty set is connected. 

The appropriateness of the word ‘connected’ is shown by the 
next two theorems. 


Theorem 3.31. A necessary and sufficient condition for a non-empty 
set in R} to be connected is that it is an interval. 


Proof. 

Necessity. Let E be a non-empty set in R! which is not an interval. 
Then there are three real numbers a, g, b such that a < q < b and 
ace E, be Ewhileq¢ E. The sets G, = (—00,q) and G, = (g, 0) are 
open and intersect E since they contain a, b respectively. Also clearly 


GinG,nE=@ and G,UG,>E. 


Therefore £ is not connected. 
Sufficiency. Let I be an interval and let Gy, G, be open sets which 
intersect J, but are such that 


GiNG,NI= 2. 


Take a point ae G,nJ and a point be G,n J. Since a + b, we may 
suppose that a < b. Then [a, b] is a subinterval of J. Let u be the 
upper bound of the set G, n [a, 5]. Since a, b are interior points of G, 
and G, respectively and G, n G, n [a, b] is empty, it follows that 


a<u<b, 
If now 6 is any positive number such that 
a<u-—d<uté6<b, 


(u—6, u] contains at least one point of G, and (u, u+6) contains no 
points of G,. Hence (u—6,u+96) cannot be a subset of either G, 
or G,. Since G,, G, are open, it follows that u¢G, and u¢G,, so 
that G,U G, > J. Therefore / is connected. | 


Theorem 3.32. A necessary and sufficient condition for a (non-empty) 
open set in R” (or Z) to be connected is that any two of its points may 
be joined by a polygon lying entirely in the set. The polygon may be 
chosen so that its sides are parallel to the coordinate axes. 


Proof. 
Necessity. Let G be open and connected. Take a point c in G and 
let G, be the set of points in G which can be joined to,c by a polygon 
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in G. Let G, = G—G, so that G,nG, = @ and G,UG, = G. We 
shall see that G, and G, are also open. ‘ 

If x is any point of G,, there is a B(x; €) < G. All points in B(x; €) 
can be joined to x by a line segment in B(x; €) and so in G. Since x 
can be joined to c by a polygon in G, so therefore can all points in 
B(x; 6). Hence B(x; ¢€) < G,. Thus G, is open. The same kind of 
argument shows that G, is open. 

Since G is connected and is the union of the two disjoint open sets 
G,, Gy, at least one of these sets is empty. But c € G, and so G, is 
empty. Therefore G = Gy, i.e. all points of G can be joined to c by 
means of a polygon in G. Finally, any two points of G can be joined 
by way of ec. 

The polygon could be one with sides parallel to the axes, for a 
point in an open ball of R” may be joined to the centre by m segments 
parallel to the axes. 

Sufficiency. Suppose that G is open and that any two points of G 
may be joined by a polygon lying entirely in G. Let G,, G, be non- 
empty, disjoint open sets contained in G. We have to show that 
G, UG, + G. 

Take a point c, € G, and a point c, € G;. There is a polygon in G * 
which joins c, and c,. This polygon must have a segment with end : 
points p, q such that p e G, and g ¢G,. The segment may be repre- : 
sented by the vector equation 

x = x(t) =pt+(q—-p)t O<t< 1). 
Let u be the upper bound of the numbers ¢ such that x(r) € Gy. 
Arguing in much the same way as in the proof of theorem 3.31 we 


see thatO < uw < 1 and x(u) does not belong to G, or to G,. Therefore 
G,UG, + G. | 


Corollary. The spaces R" and Z are connected. 

An open, connected subset of a metric space is called a region. 
Regions in Z will prove to be the natural domains of complex func- 
tions (chapter 10). 


Definition. Let (X,p) be a metric space and let E < X. A set C is 
called a component of E if it is a maximal connected subset of E (i.e. 
if C is a connected subset of E and if no other connected subset of E 
contains C). 

It is an immediate consequence of the lemma below that any two 
distinct components of a set are disjoint. 
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Lemma. Let & be a collection of connected sets E in a metric space. 
If 1 Eis not empty, then U E is connected. 
Ecé& Ecé 


Proof. Suppose that H = U E is not connected. Then there are 
Eeé 
open sets G,, G, such that 


GiNH+ @, G.NH+ 2, GiNG,ANH= 2, G,UG,> H. 
Let ae () E. Since ae H, we may assume that aeG,. If E is now 
Eeé 


any set of &,ae Zand E < H s0 that 
GNE+ 2, GNGANE= 2, G,UG,> E. 


As E is connected, we must also have G,n E = ©. It follows that 
G,N H = @, which is a contradiction, | 


Theorem 3.33. Any set in a metric space has a unique decomposition 
into components. 


Proof. Let E be a set in a metric space. For any x € E, denote by 
C, the union of all the connected subsets of E which contain x. Since 
{x} is connected (see exercise 3(c), 2), C, is not empty and, by the 
lemma, C, is connected. C, is also a component. For if C is a con- 
nected subset of E which contains C,, then C contains x and so, by 
definition of C,, C, > C. Finally it is clear that any component of £ 
is a set C,. | 


Corollary 1. An open set in R® or Z is the union of countably many 
disjoint regions. 

Proof. Let G be an open set in R” or Z and let C be a component 
of G. If xe C, then C, = C. Also there is a 3 such that B(x; 6) < G 
and, since B(x; 6) is connected (theorem 3.32); B(x; 6) < C, = C. 
Thus C is open, i.e. C is a region. It now follows from exercise 
2(c), 5 that the set of components of G is countable. | 


Corollary 2. An open set in R* is the union of countably many open 
intervals. 


Theorem 3.34. If the domain of a continuous function is connected, 
then so is the range. 

Proof. Let (X, p), (Y,) be metric spaces and suppose that the 
function f: X > Y is.continuous. If f(X) is not connected, then Y 
contains open subsets G,, G, which intersect f(X) and are such that 


G,NG,nf(X) = @ and G,UG, > f(X). - (3.31) 
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By theorem 3.23, f-(G,) and f-\G,) are open. These sets are also 
non-empty, since G, nf(X) and G, nf(X) are non-empty. Moreover, 
by (3.31), 

SG) NF™G) = @ and f-(G)uUf™(G,) = X 


and so _X is not connected. Hence if ¥ is connected, then so is f(X). | 


Corollary. If the domain of a real-valued, continuous function is 
connected, then the range is an interval. 


Exercise. Prove that, if the real function f is continuous on the interval [a, 5], 
then fassumes in this interval every value between f(a) and f(b). (The intermediate 
value theorem of classical analysis, theorem 3.6 in C1.) 


Exercises 3(c) 


1. Suppose that E < Xf Y and that the metrics p, 7 on X, Y respectively are 
identical on E. Show that E is a connected set in (X, p) if and only if it is a 
connected set in ( Y, ¢). 


2. Show that, in any metric space, a set consisting of a single point is connected; 
and that a set which consists of more than one point and contains an isolated 
point is not connected. 


3. Prove that a metric space (X, p) is connected if and only if its only subsets 
with empty frontier are @ and X. 


4. Show that in the space of irrational numbers the only connected sets are those 
consisting of single points. 


5. Prove that, if a subset E of a metric space is connected, then E is also con- 
nected. If E is connected, is E necessarily connected? 


6. Show that the components of a closed subset of a metric space are closed. Are 
the components of an open subset necessarily open? 


7. Show that the subset 
{, |x = 0, -1 < » < 1}U {@,»)|0 < x < 1, y = sin (1/x)} 
of R® is connected. 


3.4. Complete metric spaces 
Readers are familiar with the idea of a convergent sequence. We 
now introduce a closely related concept. 


Definition. The sequence (X,) of points in the metric space (X,p) 
is said to be a Cauchy sequence if, given e > 0, there is an ng such that 


P(Xm» Xn) < € whenever m,n > Ny. 
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Theorem 3.41. If (x,) is a convergent sequence in a metric space 
(X, p), then it is a Cauchy sequence. 
Proof. Let lim x, = x. Given ¢ > 0, there is an mp such that 


nc 


PA(Xn, X) < € for n > np. If now m,n > MN, 
P(Xns Xn) < Pm» X)+P(Xn» X) < 2e. | 


The converse of theorem 3.41 is not true in every metric space. 
For instance if X is the interval (0, 1) of R4, then the sequence (1/n) 
is a Cauchy sequence, for, when ¢ > 0, 


1 ‘| : 1 
——-|<e if mn>-. 
m € 

However (1/n) does not converge in (0, 1), since there is no point 
x in (0, 1) such that 1/n—x +0 as n> co. Another subspace of R* 
in which the converse of theorem 3.41 fails is the metric space of 


rational numbers. (See exercise 3(d), 2.) 


Definition. Let (X, p) be a metric space. A subset E of X (which may 
be X itself) is said to be complete if every Cauchy sequence in E has a 
limit in E. If X is complete, we say that the metric space (X, p) is 
complete. 


Notes. (i) In any metric space the empty set is complete (since it contains no 
Cauchy sequences). 

(ii) The non-empty set E in the metric space (X, p) is complete if and only if 
the metric subspace (E, o) of (X, p) is complete. 

We shall establish the vital result that R* is complete. First we prove 
a lemma which has independent interest. 


Lemma. Every sequence of real numbers has a monotonic subsequence. 


Proof. Let (x,,) be any sequence of real numbers. We call x, a 
terrace point if X, < x, for alln > p. 

If there are infinitely many terrace points, let x,, be the first, x,, the 
second, and so on. The sequence (x,,) is clearly decreasing. 

If there are finitely many terrace points (perhaps none), take an 
integer v, so that no x, form > v,, is a terrace point. There is now 
a v, > v, such that x,, > x,,. Again there is a ys > , such that 
X,, > X,,; and continuing in this way we obtain an increasing sub- 
sequence (x,,). | 


We do not need the full strength of the lemma, but only the special 
case that a bounded sequence has a convergent subsequence. 
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Theorem 3.42. The space R* (with its usual metric) is complete. 

Proof. Let (x,) be a Cauchy sequence in R?. We first show that 
(x,) is bounded. Since there is an integer p such that 

|X,—Xm| < 1 whenever m,n > p, 
it follows that —|Xn| < |xXn—Xp|+|Xp| < [xp] +1 
whenever n > p. Thus, for all n, 
|xn| < max (|xa], [2], --+» [Xp-al> [Xp] +1). 

It now follows from the lemma that (x,) has a bounded, mono- 
tonic and therefore convergent subsequence, say (x,,). Suppose that 
X,>% as k> 0, 

We shall show that x, > x asn—> oo. 
Take any positive ¢. Since (x,) is a Cauchy sequence, there is an 
integer mp such that 


|Xm—Xn| < € for m,n > nN. 
Also since x,, > x, there is an integer ky such that 
|x,—2| <¢ for k > ko 
As v;, > k, we then have, for n > max (1, ko), 
|x,—x| < |x¥n—Xr,l+1%,—%] < 2e. 
Thus x, > x as-> oo. | 


Corollary. The spaces R” and Z (with their usual metrics) are com- 
plete. 


Proof. We need only consider R”. Let (x,) be a Cauchy sequence 
in R* Wisi eta then 
|Eae— E,.| 
ert er < (Xp Xz) 
lene nal 


and so each of the sequences (£;,),>15 +++» (Enr)r>1 is a Cauchy sequence 
in R1. Therefore, by the theorem, there are real numbers &, ..., &, 


seat a> Evy von bar bn 
asr—> oo. Ifx = (&,..., ,), we then have 
PX X) < [br — Bi] +--+ |Enr— Sul 


and, since the right-hand side tends to 0 as r > 0, it follows that 
Xp > xasr> oo. | 
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Theorem 3.41 and the fact that R1 and Z are complete may be 
combined in the following statement. A necessary and sufficient 
condition for the sequence (x,) of real or complex numbers to converge 
is that, given € > 0, there is an integer ng such that |Xp—Xp| < € 
whenever m, n > mp. In classical analysis this is referred to as the 
General Principle of Convergence. 

For subsets of metric spaces there is an intimate relation between 
the properties of being complete and of being closed. 


Theorem 3.43. Let (X, p) be a metric space and let E be a subset of X. 
(i) If E is complete, then E is closed. 
(ii) If X is complete and if E is closed, then E is complete. 


Proof. (i) Let (x,) be a sequence of points in E which converges 
to a point x € X. By theorem 3.41, (x, isa Cauchy sequence in ¥ and 
so in E. Since E is complete, it follows that (x,,) converges in E, i.e. 
that x € E. Theorem 2.31 now shows that E is closed. 

(ii) Let (x,) be a Cauchy sequence in E. Since (x,) is a Cauchy 
sequence in X and X is complete, there is an x € X such that x,, > x. 
By theorem 2.31, xe E. | 


Several important metric spaces have functions as their elements. 
We shall now consider two such spaces which we have previously 
met in specialized form. 

Let (Y,7) be a metric space. The subset E of Y is said to be 
bounded if there is an open ball that contains £; and, if X is an 
arbitrary set, the function ¢: X — Y is called bounded if the subset 
¢(X) of Y is bounded. We denote by B(X, Y) the set of bounded 
functions on X into Y and we define the usual metric p on B(X, Y) 


PY pH) = sup 7040), YOO) @, HE BLY, ¥)). 


When X is also equipped with a metric, so that continuity on XY has 
a meaning, we denote by C(X, Y) the subspace of B(X, Y) consisting 
of the bounded, continuous functions on ¥ into Y. The usual metric 
on C(X, Y) is the one induced by (B(X, Y),p). When Y = R}, 
B(X, Y) and C(X, Y) are usually written B(X) and C(X) respectively. 
We have also previously used, and we retain, the notation B[a, 5] 
and C[a, b] for B(X) and C(X) when X is the interval [a, 5]. 


Theorem 3.44. If X is any set and (Y,7) is a complete metric space, 
then B(X, Y) is complete. 
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Proof. Let (¢,,) be a Cauchy sequence in B(X, Y) and let x be any 
point of X. Since 


Thm Pn) < = T(pm(E)s Pnl5)) = Pm» Ons 


it follows that (¢,,(x)) is a Cauchy sequence in the complete metric 
space ( Y, 7). Therefore lim ¢,,(x) exists for every x € X. Let 6: X¥ > Y 
ne 


be the function given by 
#@) = lim brlx) (xe X). 
The next step is to show that ¢ € B(X, Y). There is an integer p 
such that Pm: Pn) < 1 whenever m,n > p. 


Therefore, for any x € X, 


T(Pm(X), Pn(X)) < 1 whenever m,n > p. (3.41) 
Taking n = p and letting m-— oo in (3.41) we get (see exercise 
a 1($(2), Gp(0)) < 1. 


Since this holds for all x ¢ X and since ¢, is bounded (i.e. ¢,(X) is 
contained in an open ball), it follows that ¢ is bounded. 

We must still prove that ¢,, > ¢, i.e. that p(¢,,, 6) > 0 (which is a 
stronger assertion than the statement that ¢,,(x) > $(x) for every x 
—see exercise 3(d), 7). Given e > 0, there is an m, such that 


P(Pms Gn) < € Whenever m,n > No 


and so, by an argument similar to the one we have just used, we see 
that, for every x € X, 


1((x), n(x) < € Whenever 7 > No. 
Thus 


PP, Fn) = sup 7((x), n(x) < © whenever n> 1% 
and so ¢, > ¢. | 


Corollary. If X is any set, the space B(X) is complete. 


Theorem 3.45. If (X, 7) is any metric space and (Y, 7) is a complete 
metric space, then C(X, Y) is complete. 


Proof. If (¢,,) is a Cauchy sequence in C(X, Y) and so also in 
B(X, Y), then, by theorem 3.44, there is a ¢ € B(X, Y) such that 
gn > ¢ as n> co, We have to show that ¢ is continuous on X. 
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Let x) be an arbitrary point of ¥ and take « > 0. There is an n 
such that 
PP: bn) = sup TAX), Pn) < 65 


and, since ¢,, is continuous, there is a 6 > 0 such that 
T(PnrlXo), Pn(X)) < € Whenever (Xp, x) < 6. 
Hence, when (Xo, x) < 4, 
T(P(Xo)s A(X) < T(P(%0)s bulXo)) + 7b n(%o)s Pu(X)) + 7(P n(x), BOD) 
< 3e, 


Thus ¢ is continuous at x, and, since x) was an arbitrary point of X, 
¢ is continuous on X, | 


Corollary 1. If (X, o) is any metric space and (Y,7) is a complete 
metric space, then C(X, Y) is closed in B(X, Y). 
Corollary 2. If (X, 7) is any metric space, the space C(X) is complete. 


We end this section with a result that has many applications in 
analysis. 


Definition. Let (X, p) be a metric space and let Q:X>X bea 
function mapping X into itself. If now there is a non-negative number 


Kes Tauck that (0x), 2%) < kel, x’ 


for all x, x' € X, then Q is called a contraction mapping. 
Clearly a contraction mapping is continuous. 


Theorem 3.46. (Banach’s fixed point principle.) Jf Q is a contraction 
mapping on a complete metric space (X, p), then the equation Q(x) = x 
has one and only one solution (i.e. the mapping Q: X + X leaves one 
and only one point unchanged). 


Proof. Let x) be an arbitary point of X and define the members of 
the sequence (x,,) by the recurrence relation 


Xn41 = Q(X,) (n> 0). 
Then Pm» X41) = P(2% mr)» 20% m)) 


S kp(%n-1» Xm) 


< k™p(Xo; 1) 
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and 
P(Xn» Xen) < k"p(Xos x;) 
< K{p(Xo, X1) + P(X 2) + «+ + P(% a» Xy)} 
< k(x, 4) (1+k+... +k) : 


kn 
gE P(X, X1)- 


Since k” > 0 as n> ©, (x,) is therefore a Cauchy sequence and X, 
being complete, contains a point x such that x, > x. Now, since Q 
is continuous, by theorem 3.22, 


Q(xp) > QO). 
But also Q%n) = Xn > X 


and therefore Q(x) = x. 
To prove the uniqueness of the fixed point, suppose that 


OQ) =x and Q(x’) = x’. 
Then p(x, x’) = p(Q(x), QC’) < kp(x, x’) 


and so, since k < 1, p(x, x’) = 0, ie. x = x’. | 

Many theorems on the existence and uniqueness of the solutions 
of differential, integral and other equations are traditionally proved 
by various devices involving successive approximations. The essence 
of these procedures is embodied in Banach’s fixed point principle 
whose use therefore greatly simplifies the classical proofs. We illustrate 
the method by proving a theorem on implicitly defined functions. 


Theorem 3.47. Let (x, yo) be an interior point of a set E in R* and 
suppose that the function f: E > R? satisfies the following conditions. 
(i) So, ¥o) = 93 
(ii) fis continuous in an open set G containing (Xo, ¥o)5 
(iii) f, exists in G and is continuous at (Xo, Yo), and f,(Xo, Yo) + 0. 
Then there exist a rectangle 


MXN = [xp—%, X0 + 4 x [Yo— 2, Yo+ Al 
and a continuous function ¢: M +N such that y = $(x) is the only 
solution lying in M x N of the equation f(x, y) = 0. 
Proof. Put ee 1 
Filo Yo)" 
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Since /, is continuous at (Xp, Yo), there is a rectangle 
[%o-9, Xo + 4] x Lo- 2, Yo A] 
contained in G in which 
|1-af,%, y)| < 4. (3.42) 


Using the conditions (i) and (ii) we can now find a positive number 
a« < d such that, for xe M = [xy—a, x) +], 


laf(x, ¥o)| < $2. (3.43) 


By theorem 3.43, N =[yo—f,¥+/] is complete. Hence, by 
theorems 3.44 and 3.45, the spaces B(M, N), C(M, N), equipped with 
their usual metrics, are complete. Let 2 be the mapping on B(M, N) 
defined by Q(y) = x, where 


XG) = ¥x)—-af, YO) (xe M). 


Note that, if y is continuous, then y is also continuous. 
We first show that 2 maps B(M, N) into itself. Let y ¢ BUM, N). 
Then, for x € M, we have, by the mean value theorem, 


QP O)—Yo = Hx) —af@ YO) —Yo 
= W@)—af&, WO) —Do—af( Yo) — af; Yo) 
= 4@)—yol ll —af(x, W]—af(% Yo), 
where u lies between yy and y/(x) and so in N. Hence, by (3.42) and 
G42), IAW) %)=yo] < HVC)=-yl +48 < B. 


We use a similar argument to prove that Q is a contraction mapping. 
If 7, fy € B(M, N) and xe M, 


QUO) - 2) 0) = Yi) -af@, iO) - Ya) - af, Ya) 
= Va) -YWCOL-ah ol 
where v lies between y,(x) and y,(x). Therefore, by (3.42), 
P2Y), 22) < APA, ro). 


It now follows from theorem 3.46 that Q has a unique fixed point, 
which means that there is a unique function ¢: M— WN such that 
Q(¢) = d, ie. f(x, A(x)) = 0 for xe M. (The uniqueness implies, 
in particular, that d(x) = yo.) We still have to prove that the function 
¢ is continuous. But we have remarked that, if y is continuous, then 
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so is Q(y). Hence, if O* is the restriction of Q to C(M, N), then Q* 
is a contraction mapping on C(M,N). Therefore Q* has a fixed 
point and, since a fixed point of Q* is also a fixed point of Q, it 
follows that ¢ is the fixed point of N*. Thus ¢ belongs to C(M, N) 
and so is continuous. | 


A result similar to theorem 3.47 was proved in C1 (167) by entirely 
elementary means. But the present method of proof can be used for 
the general implicit function theorem involving systems of equations. 
(See theorem 7.43.) 


Exercises 3(d) 


1, Let (X, p) be a metric space and let E be a subset of X which has a limit 
point xo. Suppose also that (Y,@) is a complete metric space and that the 
function f : E > Y is such that, given ¢ > 0, there exists d > 0 such that 


o(f(x), f(x’) < € whenever x, x’ € EN B(x; 4). 
Prove that lim f(x) exists. 


Try 


2. For n = 1,2, ... let a ‘Leh ll 


Prove that (s,,) is a Cauchy sequence in Q, the space of rational numbers. Show 
also that, for every integer g, q!s, is an integer and 0 < q!(e—s,) < 1 (where 


co 
e = >) 1/n!). Deduce that e is not rational and that Q is not complete. 
0 


3. Let D be the space of real functions differentiable on [0, 2] and let p be the 
metric on D induced by B[0, 2]. Show that (D, p) is not complete. 


4. The metric o on R? is given by 


o(x, y) = 


x y 
es, R), 
i+ hx ol ex) 


Show that (R', 7) is not complete. 


5. The metrics p, 7 on a set X are equivalent. Are (X, p) and (X, 7) necessarily 
both complete or both not complete? 


6. (i) Prove that the intersection of any collection of complete subsets of a 
metric space is complete. 

(ii) Prove that the union of a finite number of complete subsets of a metric 
space is complete. 


7. If (X, p) is a metric space, we define the diameter p(E) of a bounded subset 
E of X by 
P(E) = sup p(x, x2). 


, 2,6L 


Prove the following result. 
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Cantor’s intersection theorem. If (X, p) is a complete metric space and (F,) is 
a contracting sequence of non-empty, closed sets in X such that p(F,) > 0 as 
% 


no, then 1) F, consists of exactly one point. 
n=1 
Show that, if any one of the conditions 
(i) (X, p) is complete, (ii) F, is closed, (iii) p(F,) + 0 


© 
is omitted, then ( F, may be empty. 

nel 
8. Give an example of a sequence (¢,,) and a function ¢, all in B[O, 1], such that 
(x) > 6(x) for every x € [0, 1], but 4, ++ ¢. 


9, Let V, W be normed vector spaces. Prove that, if Wis complete, then L(V, W) 
is complete. 

(Note that the metrics on L(V, W) and on C(V, W) are defined quite differently. 
The only element common to the two spaces is the zero function 0: V+ W 
such that O(x) = @ for all xe V.) 


10. The real function / is continuous on the interval [a, 5] and differentiable in 
(a, b). Also a < f(x) < b for a< x <b and |f()| <k <1 fora<x<b. 
Prove that equation f(x) = x has one and only one solution in [a, 5]. 


11. Prove the following implicit function theorem. 

Let S be the strip [a, b]x(—, 00) of R* and suppose that the function 
f: S + R' satisfies the following conditions: 

(i) fis continuous; 

(ii) f, exists in S and there are constants m, M such that 


O0<m</f(x%, vy) <M 
for all (x, y) € S. 
Then there exists a continuous function ¢ on [a, 6] such that, for a < x < b, 
y = (x) is the only solution of the equation f(x, y) = 0. 


12. Prove the following theorem. 

Let S be the rectangle [xy»—a, x9 +a]x[yo—5, yo +4] of R*®. The function 
f: S > R'is continuous and satisfies the following Lipschitz condition: There is a 
constant A such that 


| FG, YD—-S(%x, ¥2)| < Al¥i—yal for all (x,y), Je) ES. 
Also let | f(x, »)| < Bin S; and let & in [0, a] be such that 
@ < min (1/A, 5/B). 
Then the differential equation 
2 = f(xy), 
subject to the initial condition y = y) when x = Xo, has a unique solution in the 
interval [xp—@, Xo +c]. 


(First verify that y = A(x) is a solution of the differential equation, subject 
to the given initial condition, if and only if ¢ satisfies the integral equation 


co 
HX) = Yor ic #(t))dt.) 
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13. Let 2: R' > R! be defined by 
Q(x) = x+1/(1 +e"). 
Show that (i) Q has no fixed point, and (ii) for all distinct x, x. € R', 
|Q@)—Q0%)| < |x1—>]- 


14. Given 2: X + X, define NY = Q and N” = N20 N"-» (n > 2). Show that, 
if the metric space (X, p) is complete and there is a positive integer r such that 
Q” is a contraction mapping, then © has a unique fixed point. 


15. The function 2: C[0, 1] > C[0, 1] is defined by 
AG) = [Hae Ge CIO, 1h x [0 1. 


Prove that 9's not a contraction mapping, but that 2® is a contraction mapping. 


3.5. Completion of metric spaces 

In this section the notion of isometry, defined on p. 39 is essential. 
We also recall (see exercise 2(c), 11) that, if (Y, o) is a metric space, 
the subset D of Y is dense in Yif D = Y. 


Definition. Let (X, p) be a metric space. The complete metric space 
(Y, ¢) is said to be a completion of (X, p) if it contains a metric sub- 
space (Xy, >) such that 

(i) (X, p), (Xo, Fo) are isometric, and 

(ii) Xo is dense in Y. 


Theorem 3.5. Every metric space has a completion and all the com- 
pletions of the space are isometric. 


Proof. Let (X,p) be a metric space. We begin by constructing a 
metric space (X*, p*) which will be seen to be a completion of (X, p). 

(i) Definition of X*. We call two Cauchy sequences (x,), (x; in 
(X, p) equivalent and write (x,) ~ (xp) if p(x, X,) > 0 as n> oo. It 
is easily checked that we have, in fact, defined an equivalence relation. 
We denote by X* the set whose elements are the equivalence classes 
generated by this relation. 

(ii) Definition of p*. Let x*, y* be two elements of X* and let 
(x,), (,) be arbitrary members of x*, y* respectively. Then (x,), (Vn) 
are Cauchy sequences in (X, p) and 


|P%ms Vn) —PXns Yn)! < PXm» Xn) +P ms Yn) 


Therefore (p(x, ¥,,)) is a Cauchy sequence in R! and, since R? is 
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complete, lim p(x,, ,) exists. Moreover, if (x;), (y;) are any other 
n> 
members of x* and y*, i.e. (x;) ~ (x,) and (y;,) ~ (y,), then 
lens Yn) — Pins Yn) S Pn» Xn) + PV ne Yn) 
and so lim p(Xp, Yn) = lim p(X Yn)- 
no n> 
We are therefore justified in defining the function p* on X¥* x X* by 
p*(x*, y*) = lim p(Xns Yn) 
nro 


but we must still verify that p* is a metric on X*. 

Clearly p*(x*, y*) > 0 and p*(x*, x*) = 0. Now suppose that 
p*(x*, y*) = 0. If (x,) €x*, (y,) ey*, then lim p(x,, y,) = 0, i.e. 
(xn) ~ (v,), and x* = y*. Thus M1 is satisfied. It is clear that M2 
holds. To prove M3 we take (x,) €x*, (Yn) €y*, (Zp) €2* and let 
n-> co in the inequality 


P(Xns Zn) S Pn» Yn) +PVns Zn)» 


(iii) (X¥*, p*) contains a subspace isometric with (X, p). The subset 
X, of X* is defined as follows: x* € X, if and only if there is an 
xe X such that the (Cauchy) sequence (x, x, x, ...) belongs to x*. 
This x* therefore consists of all the sequences in X which converge 
to x. Evidently different points x, y in X¥ determine distinct members 
of Xo. Thus the function f: X > Xp defined by 


F(x) = x*, 

where x* is the equivalence class containing (x, x, ...), is bijective. 

If x, ye X and f(x) = x*, f(y) = y*, so that (x, x, ...) €x* and 
(y, ys.) € y*, then, by definition of p*, 

p*(x*, y*) = p(x, y)- 

Hence f is an isometry. 

(iv) Xo is dense in X*, Take an arbitrary element x* of X*. Let 
(x,) be a member of x* and, for each k, denote by x;* the element of 
X, which contains the sequence (x;,, X;, ...). Then 


pR(x*, x4") = lim p(Xp, Xx) 
no 
and, since (x,) is a Cauchy sequence, the right-hand side tends to 0 


as k > oo. Thus x;,,* > x*. This means that X, = X*, i.e. that Xp 
is dense in X*. 
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(v) (X*, p*) is complete. Let (x*,,) be an arbitrary Cauchy sequence 
in X*, Since X, is dense in X*, for each n there is a y,* € Xp such 
. Bae va") << An. 

The equivalence class y,,* contains a sequence (), Vp, -..) of points 
in X. Now 


Pm Yn) = P*Vm™s Yn™) 
S P*(Vn*, Xn) + P* (Xn Xn) + PM ns Yn'®) 
laa 
(i y* * Lal he 
< PR my nt tS. 
Since (x*,,) is a Cauchy sequence in X*, it follows that (y,) is a 
Cauchy sequence in X. Let y* ¢ X* be the equivalence class contain- 
ing (y,,). Then 


PRY, x8) < PPO, Yu") + ORR" 2%) < lim PU ns Yi) + Lk 


As (y,) is a Cauchy sequence, the right-hand side tends to 0 as 
k > ©, i.e. x*, > y*. Hence (X*, p*) is complete. 

(vi) Any two completions of (X, p) are isometric. Let (Y,c) be a 
completion of (X, p) and let (Yo, 7») be a subspace of (Y, o) isometric 
with (X,). Proceeding as in (i) we group the Cauchy sequences 
(yp) in Yo into equivalence classes y*. 

Since Y is complete, every Cauchy sequence in Y has a limit in Y 
and clearly all Cauchy sequences belonging to the same equivalence 
class y* have the same limit y. Conversely, to any ye Y, there 
corresponds an equivalence class y*. For, since Yo is dense in Y, 
there is a sequence (y,) in Y) which converges to y and y* is the 
equivalence class determined by (y,). We have therefore set up a 
bijection between the equivalence classes y* and the points y of Y. 

Let (W, 7) be another completion of (X, p) with subspace (Wo, 7) 
isometric to (X, p). As before, we have a bijection between the points 
w of Wand the equivalence classes w* of Cauchy sequences in W,, 

The spaces (Yo, 7%) and (Wo, 7) are isometric, since each is iso- 
metric with (X, p). If (y,), (W,) are corresponding sequences in Y, 
and W, respectively, then 


Fm Yn) = THs Wn) 


and therefore, when one is a Cauchy sequence, so is the other. 
Moreover, if (y/), (w;,) also correspond, then (y,,) ~ (y;) if and only 
if (w,) ~ (w,). Hence the isometry between (Yo, o) and (W4, 7») 
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induces a bijection between the set of y* and the set of w* and thence 
leads to a bijection between Y and W (which preserves the original 
bijection between Y, and W). 

Now let , y’€ Y and w, w’ € W be any corresponding pairs of 
points. Let (y,), (v}) and (w,), (Wn) be corresponding sequences from 
Y, and W, respectively such that y, >), Yn >y’ and w,>w, 
w/ > w". In view of the isometry between (Yo, 7%) and (Wy, 7%) we 


RAVE (y,y") = fim O(n 26) = Him 10%, Ws) = 11, W’) 


Thus the bijection between (Y, 7) and (W, 7) is, in fact, an isometry. | 


It is now easy to construct a completion of (X, ) which actually contains 
(X, p) as a subspace. Let xX+ =X (X*-%). 


We obtain a natural correspondence between the points x* of X* and the points 
x* of X* by using the bijection between X and Xo and by letting the points of 
X*—X, in X+ and in X* correspond to themselves. The metric p+ on X* is then 


getned 2, pret, yt) = pr(x*, y*). 


(X+, pt) is the desired completion of (X, p). We have proved that any metric 
space can be embedded in a complete metric space which is the closure of that space. 


Exercises 3(e) 

1. Let (X, p) be a metric space. Show that, if (Y, 0) is a complete metric space 
containing a subspace isometric with (X, p), then (Y, 7) contains a completion 
of (X, p). 

2. Show, by means of an example, that a metric space (X, p) may have com- 
pletions (Y, 7) and (¥;, 0) such that (¥;, 0) is a proper subspace of (Y, c) 
(ie. Y-Y, + 2). 

3. Given the metric space (X, p), let (X+, p+) be a completion which contains 


(X, p) as a subspace. Prove that a contraction mapping 2 on (X, p) has a unique 
continuous extension Q*; X+ > X*, and that Q* is a contraction mapping on 


(X*, p*). 


3.6. Compact metric spaces 


Among the properties of metric spaces considered by us the one 
with the most far-reaching consequences is compactness. 


Definition. Let (X, p) be a metric space. A subset E of X (which may 
be X itself )is said to be compact if every sequence in E has a subsequence 
which converges in E. If X is compact, we say that the metric space 
(X, p) is compact. 
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Notes. (i) In any metric space the empty set is compact. (ii) The non-empty 


set E in the metric space (Y, p) is compact if and only if the subspace (E;o) of 
CX, p) is compact. 


Illustrations 


(i) In any metric space, a set of only a finite number of points is compact. 

To prove this we need only remark that the empty set is compact and that, if 
(x,) is a sequence in the set {&), ..., §;}, at least one point &, appears infinitely 
often in (x,). 

(ii) Every finite closed interval of R" is compact. 

First consider an interval [a, b] of R*. If (x,) is a sequence in [a, b], then (x,) is 
bounded and, by the lemma to theorem 3.42, contains a subsequence (x,,) 
which converges to a point x € R'. But, for all k, a < x,, < b and so 


a<limx,, <5. 
kro 


Thus x, 7xE [a, 6] and so [a, b] is compact. 

Next, let / = [a, b]x[c, d] be a finite closed interval in R* and let (x,) be a 
sequence in I. If x, = (En, %n), then, since (,) lies in [a, 6), (€,) has a sub- 
sequence &,,,) which converges to a point & in [a, 6]. Put Eu ea Bsa Nyy = 7. 
As 77; lies in [c, d], there is a subsequence (n,) Which converges to a point 7 
in [c,d]. Also &, >&, since > £, But (6),) and (y;,) are subsequences (£,,) 
and (»,) of (,) and (7,) respectively. Therefore the subsequence (x,,) converges 


to the point x = (&, 7) in /. Hence J is compact. 

The argument leading from R! to R? may be adapted to make the inductive 
step from R"* to R”. 

(iii) R" and Z are not compact. For instance in R’ the sequence of positive 
integers has no convergent subsequence. 

(iv) C(X) (with its usual metric) is not compact. For, whatever metric X has, 
the functions ¢, (n = 1, 2, ...) given by 


(x) =n (xe X) 
are continuous on and the sequence (¢,) clearly has no convergent subsequence. 
The last two illustrations show that acomplete metric space need not 
be compact. On the other hand, compactness implies completeness. 
Theorem 3.61. A compact set in a metric space is also complete. 


Proof. Let (X, p) be a metric space and let E be a compact set in X. 
A Cauchy sequence (x,) in EZ has a subsequence (x,,) which con- 
verges to a point x ¢ £, Then 

P(Xns X) < PCXns Xs) + P%ns X) > 5 
ie. x, > x. (Essentially the same argument, in an expanded version, 
forms the last part of the proof of theorem 3.42.) | 


The property of compactness may also be expressed slightly 
differently. 


a 
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Theorem 3.62. A set E ina metric space is compact if and only if every 
infinite subset of E has at least one limit point in E. 


Proof. 

(i) Suppose that the set Z in a given metric space is compact. Let 
A be an infinite subset of £. Then A contains a countably infinite 
subset the points of which may be arranged in a sequence (x,). 
Since E is compact, (x,) has a subsequence (x,,) which converges to 
a point x¢ E, Clearly x is a limit point of the set {x,,, x,,,...} and 
so of the set A. 

(ii) Suppose that every infinite subset of E has at least one limit 
point in £. Let (x,,) be any sequence in E£. The set of points {x,, x, ...} 
may then be finite or infinite. If {x,, x, ...} is finite, then (as in 
illustration (i) on p. 61) at least one of its points occurs infinitely 
many times in the sequence (x,). Thus (x,) has a conyergent sub- 
sequence. If the set {x,, x2, ...} is infinite, then it has a limit point 
x in E and this is clearly the limit of a subsequence of (x,). | 


A bounded set in R” lies in a bounded closed interval. Since 
such an interval is compact, we now have the following result: A 
bounded, infinite set in R” has at least one limit point. This is the 
Bolzano—Weierstrass theorem, one of the earliest results in point set 
theory. 

The next result is an analogue of theorem 3.43. 


Theorem 3.63. Let (X, p) be a metric space and let E be a subset of X. 
(i) If E is compact, then E is bounded and closed. 
(ii) If X is compact and if E is closed, then E is compact. 


Proof. 
(i) If EZ is compact then it is also complete and so closed by 
theorem 3.43 (i). The direct proof is also quite simple. 
Let a be a fixed point of X. If E is not bounded, there is a sequence 
(x,) in E such that 
PGn@) >on C= 1,2, ..2)f 


Thus p(x,,@) > © as noo. If (x,,) is any subsequence of (x,), 
P(X,4, @) > 00 as k > oo and so (x,,) cannot converge. Hence E is 
not compact. 

(ii) Let (x,,) be any sequence in E and so in X. Since X is compact, 
there is a subsequence (x,,) with limit x in X; and, since E is closed, 
theorem 2.31 shows that x € £. Therefore E is compact. | 
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Corollary. In R" a set is compact if and only if it is bounded and closed. 
Although in the space R” the converse of (i) is true, in general it is 
false. A counter example is given in exercise 3(f), 3. 
In the rest of this section we investigate the properties of continuous 
functions with compact domains. 


Theorem 3.64. If the domain of a continuous function is compact, then 
the range is also compact. 


Proof. Let (X,p) be a compact metric space, let (Y,o) be any 
metric space and suppose that the function f: ¥ > Y is continuous 
on X, We wish to show that the subset f(X) of Y is compact. 

Take any sequence (y,,) in f(X). For each n choose an x, such that 
F (Xn) = Yn» (There may be several x for which f(x) = y,.) Since X 
is compact, the sequence (x,) contains a subsequence (x,,) which 
converges to a point x € X. Then, by theorem 3.22, the continuity of 
f ensures that f(x,,) >/(x). Hence, if f(x) =», ¥, >, where 
yef(X). | 
Corollary 1. If the domain of a continuous function is compact, then 
the range is bounded and closed. 


Corollary 2. If the domain of a real-valued continuous function is 
compact, then the function is bounded and attains its upper and lower 
bounds. 

The second corollary follows from the fact that a bounded, closed 
set in R! contains its supremum and infimum (exercise 2(c), 3). It 
generalizes the corresponding elementary result in which the domain 
of the function is a finite, closed interval (C1, theorem 3.71). 


Theorem 3.65. If the domain of a bijective, continuous function is 
compact, then the inverse function is also continuous (i.e. the function 
is a homeomorphism). 


First proof. Let f: X > Y be a bijective, continuous function with 
compact domain (X, p) and with range (Y, ¢). 

Let (y,,) be a sequence in Y which converges to a point ye Y. 
We wish to show that f(y) >f-(y). Put f(y,) = X,. Since X is 
compact, (x,) contains at least one convergent subsequence. Let 
(x,,) be such a sequence with limit x, say. Then, as fis continuous, 


Yn = FG%n) > FO): 
But y,, > y and so f(x) = y, ie. x = f(y). Therefore every con- 
vergent subsequence of (x,,) converges to x = f—(y). It then follows 
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by the compactness of X (see exercise 3(f),4) that x, x, or 
F7On) > f-0). 


Second proof. This is shorter, but more sophisticated. 

Let F be a closed set in X. By theorem 3.63 (ii), F is compact and, 
by theorem 3.64, /(F) is compact. Then, by theorem 3.63 (i), /(F) is 
closed in Y. Thus (f~!)~! (F) (i.e. f(F)) is closed in Y whenever F is 
closed in X. Therefore, by theorem 3.23 (ii), #1 is continuous on Y. | 


An immediate corollary is the well known theorem (C1, theorem 
3.9) that a strictly monotonic, continuous, real function on an interval 
has a continuous inverse. 7 

The property of uniform continuity, possessed by real functions 
continuous on a closed interval, was briefly discussed in C1 (§3.8). 
It was used to prove that a continuous function is integrable. We 
now consider uniform continuity in the general setting of metric 
spaces, 

We recall that, when (X,p) and (Y,o) are metric spaces, the 
function f: X + Y is continuous at the point c € X if, given ¢, there 
is a 6 such that 


a(f(x), f(c)) < € whenever p(x, c) < 6. 


Here the number ¢ depends on c (as well as on ¢) and generally one 
cannot expect one 6 to suit all c’s. When this is the case, i.e. when, 
given ¢, there is a 6 = d(€), independent of c, such that, for all c in X, 


o(f(x), f(c)) < € whenever p(x, c) < 6, 


then f is said to be uniformly continuous on X. Actually a slightly 
different, but equivalent form of the definition is more useful. 


Definition. When (X, p) and (Y, 0) are metric spaces, the function 
J: X > Y is said to be uniformly continuous on X if, given e, there is 
a0 such that 


o( f(x), f(%2)) < € whenever p(X, X2) < 6. 
The condition is clearly equivalent to the set 
E(8) = {o( fx), £(%2)) |, X2) < 5} 


being bounded and its supremum (6) tending to 0 as 6 + 0. 

Uniform continuity of course implies ordinary continuity. That 
continuity does not generally imply uniform continuity is easily 
shown by examples. 
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(i) The real function f on (0, 1) given by f(x) = 1/x is continuous, 
but not uniformly continuous. For 


E(@) = (i-z\|0 < XX <1; |a—ml < a} 
> [t-tlo<x<al—| [o<x<al 


and so E(6) is not bounded. 
(ii) The real function g on R! given by g(x) = cos (x*) is also 
continuous, but not uniformly continuous since 


o(6) = sup , [cos (x3) —cos (x3)| = 2. 


\a—a| < 


(For if x, = [(n+1)7]#, x2 = (n7)?, then x,;—x, < n-4) 
With the help of the next theorem it is also easy to exhibit uni- 
formly continuous functions. 


Theorem 3.66. A continuous function with a compact domain is 
uniformly continuous. 


Proof. Let f: X > Y be a continuous function whose domain 
(X, p) is compact and whose range lies in an arbitrary metric space 
(0). 

Suppose that f is not uniformly continuous. Then there exists an 
€ > O with the property that, to every 0 > 0 there correspond points 
x, y € X such that 


p(x, y) < 8 and o(f(x), f(y) 2 ¢ 
Thus there are sequences (x,,), (V,) of points in X such that 
P(Xns Pn) < In and o(f(%n),SOn)) 2 € 


Since XY is compact, the sequence (x,) contains a convergent sub- 
sequence (x,,) with limit «, say. We have 


Pr» 2%) < POs Xn) +P ys 2) < 1% + P%ps > 0 
as k > oc, Hence X,2% and yy, >; 
and, since f is continuous, 
Sn) ~f@%) and fY,) >f@)- 
Thus O(f(%,)sf(Y,,)) > 0. (3.61) 
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However ((x,,, ¥,,)) is a subsequence of the sequence ((x,, ¥,)) and 
therefore o(f(x,,),f(Vy,)) 2 € for every k. (3.62) 


As (3.61) and (3.62) are incompatible, fis uniformly continuous. | 


A simple example (for instance a constant function on a non-compact set) 
shows that the condition of the last theorem is not necessary for uniform con- 
tinuity. 

Exercises 3(f) 


1. The metrics p, o on a set X are equivalent. Prove that (X, p) is compact if and 
only if (X, 7) is compact. 


2. Prove, without using theorem 3.43, that a compact subset of a metric space is 
closed, 


3. Let B[O, 1] have its usual metric and let ¢ be the function defined by (x) = 0 
for 0 < x < 1. Show that the bounded and closed set B(#; 1) is not compact. 


4, Let (x,) be a sequence in a compact metric space. Show that, if every conver- 
gent subsequence (there is at least one) converges to the point x, then x, > x. 


5. (i) Prove that the intersection of any collection of compact subsets of a 
metric space is compact. (Show first that the intersection of a compact set anda 
closed set is compact.) 

(ii) Prove that the union of a finite number of compact subsets of a metric 
space is compact. 


6. Show that, in a compact metric space, every contracting sequence of non- 
empty, closed sets has a non-empty intersection (cf. exercise 3(d), 7). 


7. The function f: [a,20) > R! is continuous, and f(x) > / as x > 2%. Prove that f 
is uniformly continuous on [a, «). 


8. The real functions f, g, h, k on [0, «) are defined by f(x) = x*, g(x) = sin x, 
h(x) = (x+1)~ cos (x*), k(x) = x. Which are uniformly continuous on [0, ©)? 


9, A real function on an interval [a, 5] is called piecewise linear if there are points 
x:@i = 0, 1,...,”) such that a = xy < x1 <...< Xn-1 < Xn = 6 and the function 
is linear on each interval [x;., x] (i = 1, ..., ). 

Show that, given any function fe C[a, 6] and any ¢ > 0, there is a piecewise 
linear function g € C[a, b] such that p(f, g) < ¢ (where p is the usual metric on 
Cla, b)). 


Note. In classical analysis and algebra a real function / is called /inear if it 
is of the form f(x) = ax + b (xe R), i.e. if it has a straight line graph. The 
nomenclature is carried over to functions on R” to R! and to complex functions. 

This usage clashes with the definition of a linear function on p. 39 unless 
5=0. It is, however, long-established and expressive and we occasionally employ 
it. The context will make clear the interpretation intended. (The vector space 
terminology for the function f above is affine.) 
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10. The functions f, g: C[0, 1] > C[0, 1] are given by 
x wr 
SI) -f Pt)dt, g(9)(x) -[ ea)dt (SE C0, 1], xe[0, 1). 
Show that both functions are continuous on C[0, 1]. Are they uniformly con- 
tinuous ? 
11. Let E be a compact set in a metric space (X, p). Prove that there are points 


x, y € E such that 
-s P(E) = plx, y). 


(For the definition of the diameter p(E) of E see exercise 3(d), 7.) Show also that, 
if E is assumed to be merely bounded and closed, then such points x, y need 
not exist. 


12. In a metric space (X, p), the distance between the point c and the subset 
E of X, denoted by p(c, £), is defined by 


p(c, E) = inf pc, x). 
wvek 


Prove that the function f: ¥ > R! given by 
f(x) = p(x, E) 
is uniformly continuous on X. Prove also that p(x, E) = 0 if and only if xe E. 


13. In a metric space (X, p), the distance between the subsets A, B of X, denoted 
by p(A, B), is defined by 
p(A,B)= inf p(x,y). 
wed, yeB 


Prove that, if A, B are compact, there are points a ¢ A, b  B such that 
P(A, B) = pla, 6). 
Prove also that in R” (with its usual metric) p(A, B) = p(a, b) for some 
ae A, be B if one of the sets A, B is compact and the other is closed. 


14. Let (X, p) be a metric space, let A, B be disjoint subsets of X and suppose 
that one of A, B is compact, the other closed. Prove that 

(i) p(A, B) > 0, 

(ii) there need not exist points a € A, b € B such that p(A, B) = p(a, b). 


15. Give an example of a metric space (X,p) with disjoint, closed subsets 
A, B such that p(A, B) = 0. 


3.7. The Heine-Borel theorem 


In theorem 3.62 we considered a property which was evidently 
closely related to that of compactness and we proved that the two 
are, in fact, equivalent. In this section we shall establish a character- 
ization of an entirely different kind. 


Definition. A collection of sets A is said to be a covering of a set 
Eif Bia Weal 


Ace 
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The covering is finite if has a finite number of members only. When 
Eand the sets A of sf all lie in a metric space, the covering is said to be 
open if every set A of & is open. 

If Z and A, are both coverings of E and A, < 4, we say that A, 
is, relatively to J, a subcovering of E. 
Mlustrations 

(i) In Z let E = BQO; 1) and let Ay = B(E; 1), Then E is covered by the sets 

Ay (CEE). 
(ii) The interval (0, 1) is covered by the open intervals 
Gs) O<'% <1). 
(iii) The set C[0, 1] is covered by the sets 
An = {$|¢ € BLO, 1]; n-—1 < £0) < n+1} (1 = 0, +1, +2,...). 

The covering (i) clearly contains finite subcoverings. The covering in (ii) 
contains only infinite subcoverings, while that in (iii) has no proper subcoverings. 

We shall show that a necessary and sufficient condition for a set 
in a metric space to be compact is that every open covering of the 


set should contain a finite subcovering. The sufficiency is easily 
verified; the proof of the necessity requires some preparation. 


Lemma 1. Let E be a compact set in a metric space (X, p) and let € 
be a given positive number. Then there is a finite number of points 
C1, «++ Cp in E such that 
Pp 
E'S U Ben; ©): 
n=1 

Proof. Take c, to be any point of £. If E, = E—B(c,; €) is not 
empty, let c. be any point of £,. Generally, if it has been possible to 
choose ¢, ..., ¢, and if 


k 
Ey = E~U Ben; 6) 
n=1 


is not empty, c,,, is taken to be some point of E,. We wish to show 
that, after a finite number of steps, we arrive at an empty £,. 

Suppose that no E;, is empty, so that we obtain an infinite sequence 
(c,). When n > m, Cy € B(Cm} ©), i.e. 


PlCms Cn) 2 & 


Hence (c,,) cannot have a convergent subsequence (for such a sub- 
sequence would have to be a Cauchy sequence), This contradicts the 
hypothesis that E is compact. | 
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Lemma 2. Let E be a compact set in a metric space (X, p) and let G 
be an open covering of E. Then there is a positive number « such that, 
for every x € E, the open ball B(x; %) is contained in some member 
Gof. 


Proof. Suppose that the lemma is false. Then, for every n, there 
is an x, € E such that B(x,;1/n) is not contained in any G of Y. 
Since E is compact, (x,,) has a subsequence (x,,.) which converges to a 
point x* € E. Let G* be a member of Y which contains x*. Since G* 
is open, there is a 6 > 0 such that 

B(x*; 26) < G*. 

For all sufficiently large values of k, p(x,,, x*) < 6. Hence there is 
an integer 7 such that 

A(X, x*) < 6 and r> 1/d. 
If then x € B(x,; 1/r), 

p(x, x*) < p(x, x,) +, x*) < 26 

ie. x € B(x*; 26). Therefore 

B(x,; 1/r) < B(x*; 26) < G*. 


This is a contradiction, since the B(x,,; 1/n) were chosen to be open 
balls not lying in any member G of ¥. | 


Theorem 3.7. (Heine-Borel.) A set in a metric space is compact if and 
only if every open covering of the set contains a finite subcovering. 


Proof. 

(i) Let E be a compact set in a metric space and let Y be an open 
covering of E. By lemma 2, there is an « > 0 such that, for every 
x € E, B(x; «) is contained in some G of Y. Having chosen «, we can, 
by lemma 1, find points ¢,, ..., c, such that 


Ec U Bley;4). 
n=1 

Now, for each n such that 1 < n < p, there is a member G,, of 

such that B(c,; «) < G,. Then 


p 
Ec UG, 


n=1 


and so {G, ..., G,,} is a finite subcovering. 


70 CONTINUOUS FUNCTIONS ON METRIC SPACES [3.7 


(ii) Let E be a non-compact set in a metric space. Then, by 
theorem 3.62, E contains an infinite subset D which has no limit 
points in E. Therefore to each point c € D there corresponds an open 
ball G, = B(c;r,) such that G,n D = {c}. Moreover the open set 
G = (D)' is such that Gu D > E. Therefore 

Y = {G}U {G,|c € D} 
is an open covering of E. But the only member of Y which contains 
a given point ce D(< £) is G,. Hence every subcovering must con- 
tain the infinite collection {G,|c €¢ D} and so Y contains no finite 
subcovering. | 
Exercises 3(g) 

1. A set Ein a metric space is called totally bounded if it has the property which 
was proved for compact sets in lemma 1, namely that, given « > 0, there are 


points c, ..., cp such that p 
EC U Ben; 6). 
n=1 


Prove that a totally bounded set is bounded and show, by means of an example, 
that a bounded set need not be totally bounded. 


2. Let E be a totally bounded set in a metric space. Show that, given a sequence 
(x,) in E, there are sequences (1,1), (%2,n)s (X3,n), «+. Such that (x1,,) = (x,) and 
for k > 2, 

(i) (Xx,n) is a subsequence of (x;_1,n), 

(ii) (x, n) lies in an open ball of radius 1/k, 
Prove that (Xn,,) is a Cauchy subsequence of (x,). 

Deduce that a set in a metric space is compact if and only if it is totally 
bounded and complete. 


3. Prove theorem 3.66 by means of the Heine-Borel theorem. 


4, The function f: [a, b] > R' is said to be increasing at the point x € [a, 5] if 
there is a (x) > 0 such that 

' flu) < f&) < fe) 
when ue (x: 6(x), x] N [a, 6], vex, x+4(x)) 1 [a, A]. 
Show that, if f increases at every point of [a, b], then / increases in [a, 5] (i.e. 
f(@) <f(f) whena <a <f <b). 


NOTES ON CHAPTER 3 


§3.4. Although the fixed point principle has only recently become well known, 
S. Banach (1892-1945) proved it as long ago as 1920. It formed part of his 
doctoral thesis, which was published under the title ‘Sur les opérations dans les 
ensembles abstraits et leur application aux équations intégrales’ in Fund. 
Mathematicae 3 (1922), 133-81. 

§ 3.6. What is now called the Bolzano—Weierstrass theorem was discovered by 
B. Bolzano (1781-1848), a profound Czech mathematician whose writings were 
largely ignored during his life-time. The theorem reached a wide public only 
when it figured in Weierstrass’s lectures at the University of Berlin. 
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§3.7. E. Borel (1871-1956) proved in 1894 that a covering of a finite closed 
(linear) interval by a countable collection of open intervals has a finite sub- 
covering. The restriction of countability was removed by H. Lebesgue (1875- 
1941) who made extensive use of the improved result in his theory of integration 
(1902), By 1905, theorem 3.7 (for bounded closed sets in R”) was essentially 
known, (See Borel’s note in Comptes Rendus 140 (1905, 1), 298-300.) 

In 1871, H. E. Heine (1821-81) established the uniform continuity of a real 
function continuous on a finite closed interval. Since his argument contains 
the seeds of a covering theorem, the appellation ‘Heine—Borel’ has become 
attached to Borel’s original theorem and its extensions; but ‘Borel-Lebesgue’, 
which is sometimes used for the post 1902 versions, is probably more appropriate. 


Topological spaces. Once Fréchet had led the way to abstraction with his 
introduction of metric spaces, it was not long before mathematicians began to 
look for further generalizations. The neat definition below, which was arrived 
at only after a good deal of experimentation, rests on the observation that many 
properties of metric spaces and of continuous functions on metric spaces can be 
expressed by means of open sets without explicit mention of the metric. The 
definition of connectedness is already in this form; the Heine-Borel theorem 
gives an alternative definition of compactness in terms of open coverings; while in 
exercise 3(6), 2 and theorem 3.23(i) open sets are used to formulate the property 
of continuity. 

Given a non-empty set ¥, a collection 7 of subsets of X’is said to be a topology 
on X if it has the following three properties: 

(i) @ and X belong to 7, 

(ii). the union of any collection of sets in.7 belongs to 7, 

(iii) the intersection of a finite number of sets in .7 belongs to 7. 

If 7 is a topology on X, then the pair (X, 7) is called a topological space and 
the members of 7 are called the open sets of (X,.7). Since the collection of 
open sets of a metric space has the properties (i)-(iii), a metric space is a topolo- 
gical space. Equivalent metrics on a set generate the same topological space. 

A topological space is called metrizable if there exists a metric on the under- 
lying set such that the collection of open sets produced by it coincides with the 
given topology. There are simple examples to show that not every topological 
space is metrizable. For instance, if X is an infinite set, let its topology consist of 
© and all subsets G of X such that G’ is finite. If p is any metric on_X, let a, b be 
arbitrary distinct points of X and put p(a, b) = r(>0). The open balls B(a; 47), 
B(b; 4r) are both open in (X, p), but, since they are disjoint, they cannot both 
have finite complements. B(a; 4r) and B(b; 4r) therefore cannot both be members 
of the given topology. Thus topological spaces are genuine generalizations of 
metric spaces. 

Although many features of metric spaces survive the transition to topological 
spaces, there are, inevitably, some casualties. The most notable of these is the 
property of completeness; for the notion of a Cauchy sequence has no interpre- 
tation in topological spaces. (The theory of uniform spaces has been created to 
accommodate a suitable generalization.) 


Real numbers. In the notes at the end of chapter 1 we referred to the method of 
cuts which may be used for constructing the system of real numbers from that of 
rational numbers, It leads to Dedekind’s fundamental theorem (p. 16) from 
which, in turn, follow results such as those on the existence of suprema and infima 
of bounded sets of real numbers, the convergence of bounded monotonic sequences 
(C1, theorems 1.8 and 2.6), and the completeness of R’ (theorem 3.42). 
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We now sketch a construction of the real numbers which is based on the notion 
of a Cauchy sequence. For a detailed exposition see H. A. Thurston, The Number 
System. 

Let Q be the set of rational numbers. Elementary analysis within Q employs 
the customary definitions with rational ¢’s. Thus the sequence (x,) of rational 
numbers is said to converge to the rational number x, and we write x, > x, if, 
given any rational ¢ > 0, there is an integer m» such that 


|xn—x| <¢€ whenever n> No. 


Again, a Cauchy sequence in Q is a rational sequence (x,,) such that, given any 
rational ¢ > 0, there is an my such that 


|Xm—Xn| <€ whenever m,n > No. 


We define the equivalence of two Cauchy sequences (x,), (x;,) in Q as at the 
beginning of the proof of theorem 3.5: (x,) ~ (x)) if x,—x, +0 as n>. 
The equivalence classes generated in this way are then called real numbers. We 
denote real numbers by starred letters. If x is a rational number, the real number 
x* which contains the sequence (x, x,...) is called the corresponding real rational 
number. Note, however, that in general the use of the symbol x* does not carry 
with it the implication that x* is necessarily a real rational number. 

The next step is to define the algebraic operations with real numbers. If x*, y* 
are two real numbers and (x,), (x’,) € x*, (Vn), (7%) ey", then (X,+)n) ~ Of +94) 
and (xnyn) ~ (xiy%). We can therefore define x*+y* and x*y* to be the real 
numbers containing the Cauchy sequences (x, + ,) and (x,),,) respectively. Also 
—x* is, unambiguously, defined as the real number containing (—~x,). The 
definition of x*-1, when x* + 0*, is not quite so simple to justify. It needs the 
following lemma. 


(1) If (x,) € x* + O*, then there is a rational number k > 0 such that \x,| > k 
for all sufficiently large n. 

If (1) were false, there would exist a subsequence (x,,) tending to 0 and this, 
in turn, would imply that the Cauchy sequence (x,,) tends.to 0. Thus (1) holds, It 
follows that, if (x,), (xi) ex* + 0* and x, + 0, x), + 0 for all n, then (x71) 
and (x‘~") are equivalent Cauchy sequences. We can therefore define x*~* to be 
the real number containing (x;"). It is now easy to prove that the real numbers 
form a field whose zero element is 0* and whose unit element is 1*. (See axioms 
A1-A6 on p. 15.) 

A slightly stronger form of (1) is that, if (x,) ¢ x* + O*, then either (i) there is 
a rational k > 0 such that x, > & for all sufficiently large x, or (ii) there is a 
rational k > 0 such that x, < —k for all sufficiently large 7. We then say 


SP ScOMenony seh -00* 
according as (i) or (ii) holds (for the same statement holds for all Cauchy 
sequences in x*). Clearly x* > 0* if and only if —x* < 0*. We define 

x > yy" Coryti<ix®) 


to mean that x*—y* > 0*. With this definition of > it may be shown that the 
field of real numbers is, in fact, ordered. (See axioms O1-O3 on p. 16.) 
Finally we define the modulus of a real number by 


{ BS ichan tae gular AS 


ote ites rece, 


|x*] 
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It is a simple matter to verify that the bijection between the rational numbers 
and the corresponding real rational numbers preserves algebraic relations and 
order, i.e. if x, y are rational numbers, then 


@) Gty)* = x8+y", Gy)* = x%*, (—x)* = —x*, GO) = xt 
and 

(3) x* = y* according as x S y. 

Moreover, by (2) and (3), 

(4) |x|* = |x*| 

and so also 

(5) |x*| S |y*| according as |x| & |y|. 


At this stage we could develop the elementary analysis of real numbers on 
the basis of the familiar definitions of convergent sequences and Cauchy sequences 
(which now use real e*’s), Taking this development for granted we next show 
that the set of real rational numbers is dense in the set of real numbers, i.e. that, 
given any real number x*, there is a sequence (x,,*) of real rational numbers such 
that x,,* + x*. This is a corollary of the following assertion. 


(6) If x*, y* are real numbers and x* < y*, there is a real rational number u* 
such that x* < u* < y*, 

To prove this let (x,) € x*, (y,) ¢ y*. There is a rational number k > 0 such 
that y,—x, > k for n > 4, say. Also |x,—x,| < 4k for m,n > ¥p, say. Let 
v = max (4, ¥,) and put u = x,+4k. Since 

Xnttk <u < y,—dk 
for n > », the real rational number u* (which contains (u, u,...)) is such that 
ae uh<g 

The last theorem has three further important consequences. 

(7) If x, Xn (n = 1, 2, ...) are rational and x*, x,* (n = 1,2, ...) are the corres- 
ponding real rational numbers, then x,,* > x* if and only if X, > x. 

Suppose that x, > x. Given any real number e* > 0*, by (6) there is a real 
rational number 7* such that 0* < 9* < e*, By (3), 7 > 0 and so |x,—x| <7 
for n > v, say. This implies, by (5), that |x,*—x*| <9 * < e* for > v. Thus 
x,* > x*. The opposite implication follows immediately from (5). 


(8) A real rational sequence (x,*) is a Cauchy sequence if and only if the corres- 
ponding rational sequence (x,) is a Cauchy sequence. 
The proof is similar to that of (7). 


(9) If x* is any real number, if (x;) € x* and x,* is the real rational number corres- 
ponding to X,, then x,* > x*. 

Take any real number ¢* > 0*. By (6), there are real rational numbers 
n*, k* > O such that 0* < 9*+k* < e*, Since (x,) is a Cauchy sequence, there 
exists » such that =k < Xm—Xy < tk 
when m,n > v. Let m > v. Then since (7,7, ...) €* and (Xp — 2X1, Xm—Xay «++ 
€ Xm*—x*, the definition of inequality among real numbers implies that 

6h <A < x_t— xt < nt < et, 
Hence x»,* > x*. 
We are now able to prove the fundamental theorem of the present theory. 
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(10) Every Cauchy sequence of real numbers converges. 

We adapt part (v) of the proof of theorem 3.5, Let (x*,,) be any Cauchy sequence 
of real numbers. By (6), for each » there is a real ratfOnal number y,,*, corres- 
ponding to a rational number y,, such that 


[xta-n*| <n, 
Then 1¥m*—Yn*| < |¥m*—x*m| + [*m— 2% nl + [*n—In*l 
< |x*n—x*n] t+ 8, 


Since (x*,,) is a Cauchy sequence, so therefore is (y,,*). By (8), (y,) is a Cauchy 
sequence of rational numbers which determines a real number y*. By (9), 
Yn* > y*. Since 


[x*n—y*| < [x*n—yn*| + Lyn*—y*| < n*1+ [ys —y*L, 


it follows that x*,, > y*. 

We have shown that, with the usual metric, the set of real numbers is a com- 
pletion of the set of real rational numbers. Some of the arguments had counter- 
parts in the proof of theorem 3.5. There could be no question of applying the 
theorem, since real numbers are employed both in its enunciation and its proof. 

Rational numbers, having served their purpose, need no longer be used. We 
therefore abandon the * notation for real numbers. In particular, 0,+1, +2, ... 
will now denote the real numbers which were formerly written 0*, + 1*, + 2*,... 


One more theorem is needed to set analysis on its customary course. 


(11) Uf the non-empty set E of real numbers is bounded above, then it has a least 
upper bound (supremum). 

Let U be the set of upper bounds of E. Take x, € U’, x, € U, so that x1.< x. 
Either 4(x, +.) € U’ or 4(x,+2) € U. In the former case put x3 = 4(x1+ 2), 
X, = xX,; in the latter put x3 = x1, x, = 4(x, + ,). Continue this process. When 
X1, .++) Xo, have been chosen, then 


Xanga = H%on—1+Xan)y  Xanp2 = Xan OF Xanga = Xan-1y Xanga = H(%on-1+ Xan) 
according as $(X2n_1+ Xan) belongs to U’ or to U. We have 

PRA tear eee ie Pade a 
with Xan-1 € U’, Xan € U for n = 1, 2, .... Also clearly 

|Xm—%n| <(x_—x,)/2” if m,n > 2v+1 


and so (x,) is a Cauchy sequence. By (10), (x,) converges to a limit x. 
If ye E, y < Xe for all n. Hence y < x for every ye E, ie. xe U. But, if 
z < x, there is an m such that 
2 < Xong1 SX 


and so z € U’. Hence x is the least member of U, i.e. x is the supremum of E. 

Clearly Dedekind’s theorem is a consequence of (11). 

From this point the development of analysis follows the same lines whether 
cuts or Cauchy sequences are used to define real numbers. The two methods 
yield logically distinct objects (a cut of the rational numbers is not the same as 
an equivalence class of Cauchy sequences), but the effect is the same, since 
precisely the same theorems hold for the two systems. 


4 
LIMITS IN THE SPACES R' AND Z 


4.1. The symbols O, 0, ~ 


In this chapter we shall develop the theory of sequences and series 
of real and complex numbers, building upon foundations such as are 
laid in C1. We start by defining three symbols which contribute to 
brevity of statement. 

Suppose that (x,,) and (v,,) are sequences of real numbers. 

(1) When v,, > 0, we relate the magnitude of x,, to that of v, by 
two definitions. 

(i) If there is a constant K such that 


[Xn] < Koq 


for all n, we write X, = O(v,). 
(ii) If, asn>o, 


Xn _, 9, 
Vn, 
we write X, = o(V,). 
(2) If, asn> co, 
Xn] 


> 
n 


we write X, ~ Un 


Illustrations 
X, = O(1) means that x, is bounded. 
Xn = o(1) means that x, +0 as n> oo, 
If x, = 5n*—7n+9, then 
Xn = O(0), Xn ~ 5Sn*, Xn = O(n), 


Observe too that x, = O(n") and that O does not rule out o or ~. 


The notation lends itself to an extended usage. We can write, for 
i O(v,) + O(W,) = O(n + Wp). (4.11) 


This means that, if a given sequence (x,,) satisfies x, = O(v,) anda 
given sequence (y,) satisfies y, = O(w,), then x,+y, = O(v,+w,). 
Note that, if v, = w,, the relation (4.11) becomes 


O(v;) + OW) = On). 
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We are also able to express concisely a number of other steps 
which could occur in the manipulation of sequences, such as 


Olv,) +O(Up) = O(Ly), 
OWv,,) O(W,) = O(P,Wn)s 
OW’) OW) = OV Wn), 


E Ol) = 0, 


Vy ~ Wy > Vn FO(Wn) ~ Woe 


To demonstrate how these symbols retain the gist of an argument and slough 
off what does not matter, we investigate the convergence of Lu,, where ~~ 


5n?—7n+9 
irre 
and k is a constant. 

We have u,, = O(1/n"-*), so, if k > 3, Xu, converges. 

An O relation, expressing as it does only an upper bound, can never establish 


divergence. However here we have 
5 


Uy, ~ — 
nk-2 


and so Lu, diverges if k < 3. 
We have defined O, 0, ~ for functions of the integral variable 


nas n-> oo. The definitions are adaptable to functions of the con- 
tinuous variable x as x tends either to 00, — oo or to a finite limit. 


Mlustrations 


As x >, x19 = o(e*), sin x = O(1). 
As x > 0+, x? = o(x), e7/* = o(1), sin x = O(x) orsinx ~ x. 
As x+0, sin (1/x) = O(1), 1—cos x ~ 4x°. 


Exercises 4(a) 


1, Find whether the relations x, = O(vn), Xn = O(Un), Xn ~ Un imply the corres- 
ponding relations between 


n n n n 
(a) Dx, and Dv, (6) If x, and II », 
ro1 1 rel rel 


2. Prove the following results. 
(i) If x, = O(1/n*), where k > 1, then 


¥ x, = O/n*) 


ren 


n 
and Dd x, = A+ Ol /n'), 
rel 


where A is a constant. 
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(ii) If x, = O(1/n), then 
n 
Dd x, = O(log n). 
r= 


(iii) If x, = O(n"), where k > —1, then 
n 


D x = O(n), 
1 


r= 


r 
(Use the inequality 1/r* <[ (1/x*)dx (k > 0).) 
-1 


ir 


3. Prove that, if uw, ~ v, and v, = O(1), then u,—v, = o(1). Show also that the 
hypothesis v, = O(1) cannot be omitted. 


4. Show that, if x, = O(1) and 2x, < Xn-1+2%n41 for all n, then (x,) converges. 


5. Establish the following relations. 
(i) As x0, log (1+x) = x+O(x*). 
(ii) As x +0, (1+x)* = 1+ax+0(x*). 
(iii) As x > 0, sin x = x—4x°+ O(|x/5). 


6. Prove that, for r > 4, 
1 


os 0 aaa 


and deduce that, as roo, the value of the integral is 1/r+O(1/r*), Hence 


show that 2n 4 1 1 
= = log2--—<+0(—). 
oa if oE2 ana (r) 


= 1 7 
7. Prove that, as x + 00. Cae at 
3 iH I x*+n% 2x 


(Use the fact that, if the function f on [1, ) is positive and decreasing, then 
N N 

Y f@- f(x) dx tends to a limit / such that 0 < / < f(1) (C1, 141).) 

n=1 1 


4.2. Upper and lower limits 


So far in this book (and in C1) the symbol oo has only occurred in 
the designation of an interval (such as 0 < x < ©) oras part of the 
phrase ‘x, > 0’. It is now convenient to extend the usage. For 
instance we shall use ‘lim x, = 00’ to mean the same thing as 
“X_ > 00°; or ‘sup x, = 00” to mean that (x,,) is not bounded above. 
Other phrases involving oo occur in the two definitions of this 
section. However, as heretofore, we shall not attempt to perform 
any algebraic operations with oo and — 00. 
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The sequence 1 
Xp, = sin dam + 
does not converge, but 
Xara —1, Xp 0, Xen >1 


as r > oo. Hence 1 and —1 are the greatest and least numbers which 
are limits of subsequences of (x,). These will be called the upper and 
lower limits of (xp) (see theorem 4.21, corollary 2). For the formal 
definitions we prefer, however, a different approach. 

Given any sequence (x,) of real numbers, consider successively the 


sequences 
M1, Xyy Xap «+0» Xny Xnpas ++e9 


wai phtasae ee (4.21) 


If (x,) is bounded above, these sequences have suprema 
I Fs co atans 


For) alll 1, KG > Kyrie SINCE (hus Neias Mngasl--<) teats eee 
(in fact K, = max (x, K,,41)). Hence K,, tends either to a finite limit 
or to —oo. Moreover K,, > —oo if and only if x, > —oo. For if 
X, > —00, then, given any number K, however large, there is an m™ 


such that x, < —K forn > mp. Hence, forn > m, K, = sup x, < —K 
rn 


and so K,, -> — oo. On the other hand, if K,, > — 00, then x,, > —o0, 
since x, < K,. 

If (x,) is not bounded above, none of the sequences (4.21) is 
bounded above, i.e. sup x, = 00 for all n. 

rn 

Definition, Let (x,,) be a sequence of real numbers. 

If (xp) is bounded above, 

A = lim (sup x,) 


no Tr2n 
is called the upper limit (or limit superior) of (x,,) and we write 


lim x, = A or limsupx, =A. 


neo no 
If (X,) is not bounded above, we write 


lim x, = 00 or limsup x, = ©. 


no noo 
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If (x,) is bounded below and kj, k,,... are the infima of the 
sequences (4.21), then k, < kp4, for all n and k,, tends to a finite 
limit unless x, > 00. We are therefore led to the following definition. 
Definition. If (X,) is bounded below, 


A = lim (inf x,) 
no r2n 


is called the lower limit (or limit inferior) of (x,) and we write 


lim x, =A or liminf x, = A. 


n>o nD 
If (X,) is not bounded below, we write 


lim x, = —00 or liminfx, = —©. 


no 


no 


We have lim inf x, < lim sup x, (4.22) 


no no 
since inf x, < sup x,; and 
r>n r2n 
lim inf (—x,) = —lim sup x,, (4.23) 
since inf (—x,) = —sup x,. Note that the upper and lower limits 
ran r2>n 


in (4.22) and (4.23) need not be finite, 
A convenient characterization of finite upper and lower limits 
is given in the next theorem. 


Theorem 4.21. 
(i) The number A is the upper limit of the sequence (x,) if and only 
if, givene > 0, 
(a) x, < A+e for all sufficiently large n; and 
(b) x, > A—e for infinitely many n. 
(ii) The number A is the lower limit of the sequence (x,) if and only 
if, givene > 0, 
(c) X, > Ae for all sufficiently large n; and 
(d) X_, < A+e for infinitely many n. 


Proof. 
(i) Necessity. Suppose that A = lim sup x, = lim K,, where 
K,, = sup x,. Then, given ¢ > 0, there is N such that 
r2n 


Ky < Ate 


and so X, < Ate for n>N. 
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This is (a). To prove (b) we need only show that, given any integer p, 
there is an > p such that x, > A-—e. 

Since (K,,) decreases, K,, > A for all m. So, by the definition of 
K,4., there is an n > p+1 such that 


Xn > Kyu—é 2 A—e. 
This gives (5). 
Sufficiency. Suppose that (a) and (b) hold. By (a), K, < A+e for 
n > N;by(d), K, > A—eforalln. Thus K, > A,i.e. A = lim sup x,. 
(ii) This follows from (i) and (4.23). | 


Corollary 1. The sequence (x, tends to las n - © if and only if 
lim inf x, = lim sup x, = /. 
Proof. 
(i) / finite. 
If x, > /, then, given e > 0, there is N such that 


l-e< x, < l+e (4.24) 


forn > N. Hence / = lim sup x, and / = lim inf x,,. 

If lim sup x, = lim inf x, = /, then (a) and (c) show that (4.24) 
holds for all sufficiently large n. Therefore x, >] asn > a, 

(ii) / infinite. 

Xn > if and only if liminfx, = oo. Also liminfx, = 0 
implies lim sup x, = ©. 

X, > — 0 ifand only if lim sup x, = —0o;and lim sup x, = —0 
implies lim inf x, = —o. | 


Corollary 2. A = lim sup x,, when finite, is the largest number which 
is the limit of a subsequence of (x,); A = lim inf x,, when finite, is the 
smallest such number. 


Proof. The conditions (a) and (b) show that, for every € > 0, 
there are infinitely many ” such that A—e < x, < A+e. From this 
follows that there is a subsequence (x,,) with limit A. Also (x,) 
cannot have a subsequence converging to a number A’ > A, for if 
e < A’—A, there is only a finite number of n for which x, > A’—e. 

The statement about lower limits is proved similarly or by use of 
(4.23). | 


The analogue of corollary 2 for infinite upper limits is that 
lim sup x, = —©o if and only if x, + —co; and lim sup x, = 0 if 
and only if there is a subsequence of (x,,) which diverges to 00. The 
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first statement has already been proved; for the proof of the second 


see exercise 4(b), 2. There is a similar characterization of infinite 
lower limits. 


Mlustrations 

(i) x» = (—1)"; lim inf x, = —1, lim sup x, = 1. 

(ii) Xn = 2n/(n+1); lim inf x, = lim sup x, = 2. 

(iii) x, = n{1+(—1)"]; lim inf x, = 0, lim sup x, = 2. 

(iv) xn = 1—n; lim inf x, = lim sup x, = —©. 

A proof of the completeness of R! was given in theorem 3.42, but 
a more natural proof uses upper and lower limits. 


Let (x,) be a Cauchy sequence. Given ¢ > 0, there is an N such 


may |Xm—%n| <¢€ for m,n>N. 


Thus Xy-€<X,<Xyte for n>N 
andso xy—€ <ky < limk, < lim K, < Ky < xyt+e. 


no n—0 
Hence lim inf x, and lim sup x, are finite and 

0 < lim sup x, —lim inf x, < 2e. 
Since ¢ is arbitrary, lim sup x, = lim inf x, and, by theorem 4.21 
corollary 1, (x,,) converges. | 


We now turn to functions of a continuous variable for which we 
define upper and lower limits at oo (or — 00) and at a point. 


First suppose that fis defined on an interval (c, 00). If fis bounded 
above in some interval (X, 0), we define 


lim sup f(x) = lim (sup /(4); 
Fade an tar 
if f is unbounded above in every interval (X, 0) we write 


lim sup f(x) = ©. 


The definition of lim inf f(x) is similar. 


20 


Next let f be defined on (a—h, a)U(a,a+h), say. If f is bounded 
above in some set (a—1, a) U (a, a+%), we define 


lim sup f(x) = jim ( sup f(x); 


+ 0<|r-al<8 
if f is unbounded above in every set (a—1, a) U (a, a+), we write 


lim sup f(x) = ©. 
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The analogues of theorem 4.21 and corollary 1 are left to the 
reader. 


Illustrations 
(i) lim sup sin x = 1, lim inf sinx = -1. 
z+ 2c 
(ii) lim sup sin (1/x) = 1, lim inf sin (1/x) = —1. 
2-0 a0 


(iii) lim sup e”* = ©, lim inf e* = 0, 
2—+0 


20 


Exercises 4(6) 


1. Prove that x, = O(v,) if and only if lim inf (x,/v,) and lim sup (x,/v,) are 
finite. 


2. Prove that lim sup x, = © if and only if a subsequence of (x,) diverges to 00; 
and that lim inf x, = —oo if and only if a subsequence of (x,) diverges to — 20. 


3. Let (xn), (’n) be sequences of real numbers such that x, < yp for all n. Prove 
that 


(i) lim inf x, < liminfy,, (ii) lim sup x, < lim sup yp. 
4. Show that, if (x,), (y,) are bounded sequences, then 
lim inf x,,+lim inf y, < lim inf (x,+,,) < lim inf x,+lim sup y, 
< lim sup (x,+y,) < lim sup x,+lim sup y,. 
Construct sequences (x,), (vn) for which strict inequalities occur at every step. 


5. The sequences (x,), (yn) are non-negative and bounded. Establish a chain of 
inequalities as in 4 with products in place of sums and give an example in which 
strict inequalities occur at every step. 


6. (i) Let y, > y > 0. Prove that 
(a) if lim inf x, is finite, then 


lim inf (x,¥n) = y lim inf x,; 


(6) if lim inf x, = 00 (—oo), then lim inf (x,,) = 0 (—%); 
(c) if lim sup x, is finite, then 


lim sup (Xnn) = y lim sup Xn; 
(d) if lim sup x, = 00 (—0o), then lim sup (x;y,) = 00 (—20), 
(ii) Show that (a), (6), (c), (d) need not hold if y, + 0. 
(iii) Let y, > y < 0. Prove that, if (x,) is bounded, then 
lim inf (x,y) = y lim sup x,, lim sup (x,y,) = y lim inf x,. 


7. The function f: R! > R is continuous and increasing. Prove that, if (x,) is 
any bounded sequence of real numbers, then 


fim inf x,) = lim inf f(x,), f(lim sup x,) = lim sup f(x,). 
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8. Let Sn = UytetUny ty = yt... +U ny 


where (u,) is an arbitrary sequence of real numbers and (v,) is a sequence of 
Positive terms such that f, -> 00. Prove that 

Mestad?) Re erty . g fi u, 

lim inf  < lim inf" < lim sup * < lim sup —. 

Un fe te Un 


9. Let (x,) be a sequence of real numbers. Show that 


Xt +X yt ue tXn 
n 


(i) lim inf x, < lim inf < lim sup < lim sup x,; 
and, if x, > 0 for all n, 
(ii) lim inf x, < lim inf (x, ... ¥,)/" < lim sup (x4...x,)"" < lim sup Xn} 


Xn+1 


iii) lim inf 2“ < lim inf x4" < lim sup x1” < lim sup “4. 
x i a 


Xn ” 


10. Prove that, as n > «, 
(i) ifk > -1, 
P+ 2*§+ 0.4% ~ nA/(k+1) 
(cf. exercise 4(a), 3); 
Gi) ni" +1; 
(iii) (n!)¥* ~ n/e. 
11. One-sided upper and lower limits. Suppose that the real function f is defined 


in the interval (a, a+h). If fis unbounded above in every interval (a, a+7), we 
write lim sup f(x) = 00; otherwise we define 
+ 


a: lim sup f(x) = lim sup f(x)). 
rat 


0+ a<a<até 
lim sup f(x) and the two one-sided lower limits are defined similarly. 
aa 
Prove that, if fis defined on (a—h, a) U (a, a+h), 
lim sup f(x) = max {lim sup f(x), lim sup f(x)}, 
<a z—a- a2aat 
lim inf f(x) = min {lim inf f(x), lim inf f(x)}. 
ra a2—a— =m—a+ 
12. Semi-continuity. The function f: [a, b]> R' is said to be upper semi-con- 
tinuous at the point c € (a, b) if 


f(©) > lim sup f(x); 
ac 


and fis said to be Jower semi-continuous at c if 


S(c) < lim inf f(x). 


Semi-continuity at a, b is defined by use of the appropriate one-sided upper and 
lower limits. 

Show that, if f is upper (lower) semi-continuous in [a, b], then f is bounded 
above (below) and attains its supremum (infimum). 
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13. For the function /: [a, b] > R' define 


fO=F0) Hof) 
c—-x 


, Df(c) = lim sup— 7 


zc =% 


Df(c) = lim in 
xe 


when c € (a, b), and define Df(a), Df(a), Df(b), Df(b) as the corresponding one- 
sided upper and lower limits. 

Prove that, if Df(x) > 0 for a < x < b, then f increases in [a, b]. (First take 
Df(x) > 0 in [a, b] and use exercise 3(g), 4.) Show also that the condition 
Df(x) > 0 in [a, 6) does not ensure that / increases in [a, b). 


4.3. Series of complex terms 


The familiar tests of Cauchy and d’Alembert for series of positive 
terms (C1, 88) may be strengthened by the use of upper and lower 
limits. It is also convenient to have these tests in a form in which 
they apply to series of complex terms, and ensure either absolute 
convergence (and so convergence) or divergence. 


Theorem 4.31. (The root test-Cauchy.) Let =u, be a series of 
complex terms. 

(i) Uf lim sup |u,|¥”" < 1, then Zu, converges absolutely. 

(ii) Zf lim sup |u,|!” > 1, then Xu, diverges. 


Proof. 
(i) Let lim sup |w,,|”" = A and take c so that (0 <)A <ec <1. 
By theorem 4.21, there exists N such that 


|u,/2* <.e -and’so |u, |) < c™ 


for alln > N.SinceO < c < 1, Zc” converges and so, by comparison, 
=|u,,| converges, i.e. Zu, converges absolutely. 

(ii) Suppose that lim sup |w,|” > 1. If the upper limit is infinite, 
|u,|"" is unbounded. Otherwise we again appeal to theorem 4.21. 
In either case we see that there are infinitely many » for which 
|u,|/" > 1, or |up| > 1. Therefore u,, +> 0 and so =u, diverges. | 


Theorem 4.32. (The ratio test-d’Alembert.) 
(i) Uf lim sup |uj41/Un| < 1, then Lu, converges absolutely. 
(ii) Zf lim inf |up41/u,| > 1, then Xu, diverges. 


Proof. 
(i) If lim sup |Un41/Un| < ¢ < 1, there is an N such that 


|Ungi/Un| <¢ for n>N, 


4.3] SERIES OF COMPLEX TERMS 85 
Then, for n > N, 

| Un 
Una 


|u| = |uy| Uns < |uyle"-¥ = Ac* 
uy 


and therefore ¥|u,,| converges. 
(ii) There is an N such that |u,43/u,| > 1 for n > N. Hence 
Juy| < Juysal < ... and so u, +> 0. | 


Exercise. Give an example of a convergent series Zu, with 
lim sup |unys/p| > 1. 
By exercise 4(4), 9 (iii), 
lim inf |u,.41/4p| < lim inf |u,|1/" 
< lim sup |u,|"" < lim sup |uys1/Up|- 


Therefore theorem 4.32 follows from and is weaker than theorem 
4.31. (See exercise 4(c), 2.) 


Exercises 4(c) 
1. Give examples to show that, when lim sup |u,|"" = 1, the series =u, may 
converge or diverge. Show also that both convergent and divergent series may be 
such that lim sup |Upi1/n| = 1 or lim inf | upj1/un| =1. 


2. Give an example of a series which theorem 4.31 shows to converge and to 
which theorem 4.32 is not applicable. Give a corresponding exam le of a 
divergent series. 


3. The sequence (w,) of real numbers is such that lim sup u, < 0. Show that, if 
a > 1, then the series Sigtettun 


converges. 


4. Investigate the convergence of the series whose nth terms are 


jy HAM sgn, iy 3D! 109, 
di Gn)! 10", (ii (4n)! 10", 
5. Show that the complex series 
spat 
(1—in)" 


converges absolutely. 
6. Find all the real values of x for which the series =x"/n* converges, 


7. Find all the pairs of complex number a, b for which the series Za"’b" converges. 
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4.4, Series of positive terms 

In this section all series have positive terms. Although theorems 
4.31 and 4,32 are useful for such series, more delicate tests are 
available. 

The proofs of the last two theorems use a comparison principle, 
introduced in C1, in which the terms of a given series are compared 
with those of a series whose convergence or divergence is known. 
We may also compare ratios of terms. 


Theorem 4.41. If, for alln > N, 
Unit < Unt 
Un = Vp 
and Xv, converges, so does Su, If the opposite inequality holds and 
Xv, diverges, then Xu,, also diverges. 
Proof. The statement about convergence follows from the relation, 
forn > N, 


vy. v 
vnrey Un Sy ee uy v,. | 
uy Un-1 vy Una Uv 


Un = Un 

To apply comparison principles we need a stock of standard series 
which are known either to converge or to diverge. Such a stock can 
be obtained from the theorem (C1, 141) that if, on [a, ©), fis a 


positive decreasing function, then the integral and the series 
[freoas, S40 


both converge or both diverge. 

For the next theorem only, write log, x = log (log,-1.x) (r > 2), 
where log,x = log x. 
Theorem 4.42. (The logarithmic scale.) Each of the series 


1 y 1 
n(log ny? ~ nlogn log, n...log,-1 7 (log, n)*” *~ 


1 
x ne x 
converges if k > 1 and diverges ifk < 1. 


Proof. Xt must be supposed that the summation starts with a value 
of n (say a) large enough for the repeated logarithms to be defined. 
The value of the associated integral 


iC dx -_ 
a Xlog x log, x...log,_; x (log, x)* 
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f (log, x 1-k]xX 

is [cel tk 
x 

and is [tog x| ifke= 1. 


As X > 0, the integral tends to oo if k < 1 and to a finite limit if 
Keel 


The next theorem arises from the application of theorem 4.41 to 


the first two series of the logarithmic scale. 


Theorem 4.43. (Ratio test of Gauss.) If it is possible to write 


te = 14440(4), 
n 


nm 
Uns n 


where jt is a constant, then Xu, converges if 1 > 1 and diverges if 
eel. 


Proof. Suppose “ > 1. Let 1 <q < yp. Let v, = n-%. Then, by 
exercise 4(a), 5(ii), 
Pn = (=)" = 1444 o(;:)- 
Dies n n n 


The inequality, for all sufficiently large n, 


u v 
ell sy a: 


Unt Uns 
gives the convergence of Zu,,. 
Similarly, if ~ < 1, Xu, diverges. 
If « = 1, define 


1 
% = =—. 
nlogn 
1 
Lae (1+4) {1428 er 
Uns n logn 
eee ae +0(i). 
n nlogn n* 
For all sufficiently large n, 
Un or 


< é 
Uns Uns 


Therefore Eu, diverges. | 
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The convergence tests of this section and the last are all based on 
comparison with standard series. No such test can be universal; for, 
given any convergent (divergent) series, there always exists a series 
that converges (diverges) more slowly. This fact is illustrated by 
exercises 7-10 below. 


Exercises 4(d) 


1. Another comparison principle. Show that, if Zu,, Lv, are series of positive 
terms and ‘- es 
0 < lim inf < limsup” < », 
Dp Un 


then Eu, and Zp, either both converge or both diverge. 


2. Investigate the convergence or divergence of the series whose nth terms are 


(i) (log n)~*, (ii) (log n)-18”, 

(ii) (log log n)t8", (iv) (log n)-to8to8n, 

(vy) not, (vi) 1—nlog ae 
(n+a)" 


a 2 ‘2n—1)\” 
(vii) ar (a real), (viii) (3°-") ; 


(ix) |at"-1|* @>0), @ @r-DE 


3. Show that the series 


n 1 1 n 
z (£28) ; x (1- pens ios een) 


converge fork > landdivergefork < 1.(Compare with En- and En-(logn)-*.) 
4. Find all the positive values of a for which the series 
(an)" 
= 


n! 


converges. 
5, The condensation test. The sequence (u,) is positive and decreasing and p is an 
integer greater than 1. Prove that the series 
© © 
Yun and SY puyn 
1 1 


both converge or both diverge. (Group the terms in Zu, appropriately; it is 
advisable first to consider the case p = 2.) 
Deduce the logarithmic scale. 


6. Let =u, be a divergent series of positive terms and let s, = uy+...+ Un. Show 
that the series x 
Z(Un/ sh) 


converges if k > 1 and diverges if k < 1. [For convergence prove that, when 


pices eres 
se * k—-1\8=t 47” 
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7. Given a convergent series Xu, of positive terms, construct a convergent series 
Xv, such that v_/upn > 0. 


8. Given a divergent series =u, of positive terms, construct a divergent series 
Xv, of positive terms such that vp/u, > 0. 


9, Given an increasing sequence (g,,) with lim g, = 0, construct a convergent 
series Xu, such that Lu,q, diverges. 


10. Let Uy tig t Maat oy 
Ug, + log + Ugg + ooey 
Ugi + Ugg + Ugg + 


be an infinite scale of divergent (convergent) series of positive terms each 
diverging (converging) more slowly than the one before in the sense that, for 
every Fr, Uys1,n/Ur,n > 0 (00) as n> co, Construct a series which diverges (con- 
verges) more slowly than every series of the scale. 


4.5. Conditionally convergent real series 


A conditionally convergent series is one that converges, but not 

absolutely. It was shown in C1 (93) that rearrangement of terms does 
not affect the sum of an absolutely convergent series, but may change 
the sum of a conditionally convergent one. A more precise statement 
is possible. 
Theorem 4.51. (Riemann.) Let u,, be real and Xu, conditionally con- 
vergent. Then the terms of the series can be rearranged so that the sum 
of the first n terms tends to any given limit or has assigned upper and 
lower limits (finite or infinite). 


Proof. Denote the positive terms in Ew, in the order in which they 
appear by v,, v,,... and the negative terms by w, W2, .... Then the 
series Lv,, Uw, both diverge; for if both converged, =|u,,| would 
converge and, if one converged and the other diverged, =u, would 
diverge. 

We shall rearrange the series to converge to a given sum ¢. Take 
the smallest number of v’s for which v,+v,+...+v, > t. Then take 
for the next terms of the rearranged series just enough w’s, starting 
with w,, to make the total sum < ¢. Then take more v’s in order 
from v,,, to make the sum > ¢. 

Since Ev, and Zw, diverge, this process can be continued indefin- 
itely. Let t,, be the sum of the first 7 terms of the series so constructed. 
To prove that ¢, >t we remark that |t—f,,| < |w,,|, where uw, is 
the final term of the last complete block of positive or negative terms 
included in f,,; and u,, > 0 asm -—> oo. 
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In view of theorem 4.21 corollary 2 it is easy to modify the process 
so that (t,,) has any assigned upper and lower limits. | 


The tests of the last two sections are used for proving absolute 
convergence of series whose terms are not all positive. Theorems 4.53 
and 4.54 below are often useful for establishing conditional con- 
vergence. These theorems depend on the following simple identity. 


Theorem 4.52. ate summation.) If aj, ..., Qp, Vis «++» Up are any 


numbers and s;, = Es) a; (k = 1,..., p), then 


AV + 6. FAyVy = Sy(V]—Vq) +... +S p—1(Up—1 — Vp) + SpUp> 


Proof. Each side is s,v + (52-51) 2+... + (Sp —Sp-1) Up: | 


Corollary. If vy > ... > Vp > 0 and ay, ..., a, are any real numbers 
such that 
HSS <M (KK =1,....)p), 
then MY, < ayVy+...+a,v, < Mv,. 
Proof. Since v;— V3, ..., Vp-1—Up, Up are non-negative, 
$y(Vy — 0g) +... + Sp—a(Vp—1 — Vp) + SyYp 
lies between the sums obtained by replacing each s, by ~ and M 
respectively. | 
Theorem 4.53. (Dirichlet.) Let a,, v, (n = 1, 2, ...) be real. If 
n 
(i) the sequence (s,,), where Ss, = > a,, is bounded, 
r=1 
(ii) the sequence (v,) is monotonic and tends to 0, 
then Xa,v, converges. 


Proof. We may suppose that (v,,) decreases, so that v, > 0. By (i), 
there is an H such that |s,,| < H for all n. Then 


|@ngat-+-+Gnsel = [Snse—Snl < 2H. 
Therefore, by the last corollary, 
lansing t+ +AnapYnip| < 2Hns 


for all p > 1. Since v,, > 0, the sequence (¢,,), where 


n 


eae Vrs 
a 


is a Cauchy sequence. As R' is complete, lim ¢, exists, i.e. La,v, 
converges. | 
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The alternating series theorem (C1,91) is the special case 
a,, = (—1)" of theorem 4.53. 


Theorem 4.54. (Abel.) Let ay, Uv, (n = 1, 2, ...) be real. If 
(i) Za, converges, 
(ii) the sequence (v,) is monotonic and bounded, 

then Xa,v,, converges. 


Proof. We can prove, as in theorem 4.53, that the partial sums of 
Xa,v, form a Cauchy sequence. Alternatively we can deduce 4.54 
from 4.53 as follows. 

From (ii), v, tends to a limit, say v. Let v, = v+w,, so that the 
sequence (w,) is monotonic and tends to 0. By (i), Za,,v converges. 


n 
Also (s,,), Where s, = & @,, is bounded and so, by theorem 4.53, 
r=1 
=a,,w,, converges. | 
Example. If (v,) is monotonic and tends to 0, then Xv, sin nx converges for 


all x and Lv, cos mx converges except, possibly, for x = 2km (k = 0, +1, 
ie 


When x + 2kz, 
n = 
Stele cos 4x cos (n+4) x me 1 s 
r=1 2 sin 4x |sin 4x] 
us _ {sin (+4) x—sin | 1 
aad aol ig Qsindx | ~ sin dxl 


and the result follows from theorem 4.53. 

When x = 2kz, sin nx = 0 for all m and so Xv, sin nx converges; cos nx = 1 
for all n, so that Xv, cos mx is Zv,, which may or may not converge. 

This example is frequently used in discussing the convergence of a power 
series at points on its circle of convergence. 


Exercises 4(e) 
1. Examine for convergence the series whose nth terms are 


sin nx 


(i) (-1)"a"" (@> 0), OT sce Guan) 


wen (20)! .. sinn 
(iii) 7 cos nx, (iv) ifn (n > 1), 
(v) oe (vi) (n/"—1) cos nx, 
(vii) (—1)"mrerv", (viii) cm cos *, 
(ix) sl aslaealed GaP (8) a cosna («> 0). 


logn ia 
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2. Find all the real values of x for which the series 


1 
@ x leone Gear t rors aur sin nx, 
7 1 1 1 
(ii) ol optaept tant sin? nx 
converge. 
3. Show that the series (145+..+2) =— 
2 RC 


converges absolutely for x = k7(k = 0, +1, +2, ...) and conditionally for all 
other (real) values of x. 
4, The series a, converges conditionally. Show that 

(i) Za,n* diverges if k > 1, and 

(ii) if X(a,/n*) converges, so does X(a,/n*) for B > a. 
Deduce that there is a real number @) > —1 such that U(a,/n*) converges for 
& > a» and diverges for @ < a, 


5. The sequence (a, is monotonic and converges to the limit /, Prove that the 
sum 5, of the first 2 terms of the series 


0 
X (-1)"ay 
n=1 

is such that lim sup s,—lim inf s, = |/|. 


6. Establish Dedekind’s extension of Abel’s theorem 4,54 that, if both the 
series Za, and Z|v,—vns;| converge, then Za,v, converges. State and prove a 
corresponding extension of Dirichlet’s theorem 4.53. 

The real function f on [1, 00) is such that f’(x) > 0 for x > 1 and f(x) +0 


as x > 0, Prove that f(x) > 0, f(x) < 0 for x > 1, and that z f(a) converges. 


Use the mean value theorem to deduce the convergence of 
co 
x (-D'/@ sin {log f()}. 


7. The series Zu, converges and the series Xv, of positive terms diverges. Show 
that lim inf (n/n) < 0 < lim sup (p/n). 
Find pairs of series Zu, Ev, such that 

(i) lim inf (u,/v,) = —9, lim sup (un/vp) = 0; 

(ii) up > 0, lim inf (U,/0n) = 0, lim sup (Up/v,) = 2. 


o © 
8. The series 5) u,, converges absolutely and the series >) v, converges. Let 
0 0 
Wy = UgUat Uy Unt... +lnto (n = 0,1, 2, ...). 


n n 
Prove that x, = Xu (t—T-)s 
Z 


r=0 
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© © 
where ¢ = 3) v,, 7 = ) v,, and deduce that 
0 ntl 


Ee % © 
a= (= us) (3 v)- 
n=0 n=O n= 0 
(In theorem 5.7 of C1, Zu, and Lv, are both assumed to be absolutely con- 


vergent and =w, is proved to be absolutely convergent also.) 
Construct conditionally convergent series Xu, Zv, such that Zw, diverges. 


9, The terms of the series 1-—4+4-4+... 


are rearranged according to the following rules. 
(i) The order among the positive terms and the order among the negative 
terms remains unchanged. 
(ii) If, of the first m terms, p, are positive and g, are negative, p,/gn > k (> 0) 
as n>, 
Prove that the sum of the series is 4 log 4k. 
10. The sequence (a,,) is decreasing and a, ~ //n. Show that, if the terms of the 
series 
@,—Q,+a3—ayt+... 
are rearranged as in 9, then the sum of the series is increased by 4/ log k. 
11. For what values of k is the series 
1 VO Cs Ca 
pete RT SET TE ge 


with a negative term following two positive ones, convergent? 


Sri 


4.6. Power series 


In C1, §5.5 and §5.6, it was shown that every power series Xa,,z” 
has a radius of convergence R and that R = lim |a,/a,4,|, if this 
limit exists. By using upper limits we can give a simpler proof of the 
first result and we can sharpen the second. 

Theorem 4.61. 
(i) Zflim sup |a,,|"" = 0, then Za,,z” converges absolutely for all z. 

(ii) flim sup |a,,|"" = 00, then Za,,z" converges for z = 0 only. 

(iii) Jf 0 < lim sup |a,,|"" < oo and 

pin Aton Foca 
lim sup |a 
then a,,z" converges absolutely for \z| < Rand diverges for \z| > R. 

The radius of convergence of Xa,,z" is therefore R, where R is called 
co in the case (i) and 0 in the case (ii). 

Proof. 

(i) For every z, lim sup |a,z"|”" = |z| lim sup |a,|" = 0 and 
so, by theorem 4.31, Za, 2" converges absolutely for all z. 


dn? 
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(ii) For z + 0, lim sup |a,z"|”” = |z| lim sup |a,|”" = oo and so 
Za,,z" diverges for all z + 0. 

(iii) If |z| < R, then lim sup |a,z"|"" = |z| lim sup |a,|#" < 1 
and so La,,z" converges absolutely. 

If |z| > R, then lim sup |a,2"|!” > 1 and so Ea,z” diverges. | 


Theorem 4.62. The power series Xa, z" and Xna,,z"— have the same 
radius of convergence. 


Proof. By exercise 4(b), 6, 
lim sup |na,,|”" = lim sup |a,|"/", 
since lim n¥" = 1, | 


Corollary. 

(i) All the series obtained by differentiating a power series term by 
term any numbers of times have the same radius of convergence. 

(ii) A similar result holds for integration. 


Exercises 4(f) 
1, Find the (complex) values of z for which the following power series converge. 

re 2 ton 

@ x 5 (<, ;) c (ii) x nz", 
. ee 

Gi i) Bae (iv) Lien 

Vn, i 
(v) E2 os (vi) x (4 “y 
gy et can EN 2 logn ” 
(vii) x (sin 2) z" (areal), (viii) x, Sree 
z” sin na 
(ix) so 2 3 — in)? (x) D» z" (real). 


© 
2. Show that the binomial series }) 


n=0 


(*) z" (a real) has radius of convergence 1 


unless « is a non-negative integer (in which case the series terminates). Prove also 


that 


(i) when « > 0,5 (*) 2” converges absolutely for |z| = 


(ii) when -1 < @ < 0,) (*) z" converges conditionally for |z| =1,z +—1 


and diverges when z = —1; 


(iii) when « <—-1,5 (*) 2” diverges for |z| = 1. 
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(To prove (ii) show that 
C3 1 1 
/ (121)|> cur oe 


() 


if k is sufficiently small and deduce that (") >O0asn>o.,) 


3. Investigate the convergence of the hypergeometric series 


= a(at+ 1),..(a+n—1) b(b+1)...(b+n—- 1) on 
ak n! c(c+1)...(c+n—-1) 


where a, b, ¢ are real numbers not equal to 0, —1, —2,.... 


«© w 
4. The power series }) 4,2", >) 6,2” have radii of convergence R, S respectively. 
0 0 


(i) Show that the radius of convergence 7, of £ (a,+6,)z" is min (R, S) if 
R + S. What can be said about 7, when R = S? 

(ii) Show that the radius of convergence T, of 2 a,b, 2" is at least RS (where 
Roo is interpreted as oo if R > 0). Construct an example in which 7, > RS. 

(iii) Show that the radius of convergence T; of © (dybp+ 41 bn1+ «-.+anbo) 2” 
is at least min (R, S). Construct an example in which 7, > min (R, S). 


5. The sequence (ap, @;, as, ...) of non-negative real numbers is decreasing and 
ay) > 0. Show that the radius of convergence of = a,z” is at least 1. 
Prove that, if |z| < 1, then 


‘a -a(& a2") ay 


o 
and deduce that >) a,z" + 0 for |z| < 1. 
0 


<a 


4.7. Double and repeated limits 


Let X be any set. A double sequence of elements of X is a function 
whose range is in X¥ and whose domain is P?, the set of ordered pairs 
of positive integers. The members X,,, (m = 1, 2,...; = 1, 2,...) 
of a double sequence may be arranged in an array 


Xy %i2 %ig + 
Xo1 Xog X23 +e 


Xg1 Xgq Xgg «ee 


We shall only consider double sequences of real or complex numbers. 


Definition. The complex double sequence (Xmp) is said to converge 
to the number x if, given e > 0, there is an ng such that 


|Xmn—x| < € whenever m,n > Ng; 
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we then write 


Xmn > % GS m,n->oo or lim. X_,-= x. 


m,n 


Illustrations 
1 
(i) Parr >Oasm,n>o, 
e ‘ m m m | 
ii lim —— does not ts fe x sf I — =, 
@ m,n M+n See SANGENDE GA Eto Ohta! m+2m 3 


It is natural to try to relate the double limit lim x,,,, with the 


m,n 
two repeated limits lim (lim x,,,) and lim (lim x,,,). 
m0 n> no m0 
Theorem 4.71, If lim Xp, exists and, for each m, jim Xeamieress:: 
m, neo 
then lim (lim Xy_,) exists and is equal to lim Xp. 


m0 no ™m, no 


Proof. Let lim Xm, = x and lim Xn = Ym (m = 1,2, ...). Given 


m, N—0 n> 


é > 0, there is an N such that 

|Xnn—x| <e€ for m,n > N. (4.71) 
Also, given m, there is a P(m) such that 

|Xmn—Ym| < € for n> P(m). (4.72) 


Now take m > N. Ifn > max (N, P(m)), (4.71) and (4.72) both hold 
and give 
l¥m—x| < 26. 


Thus yy, > x asm—> oo, | 


Note that the existence of lim x,,, does not ensure the existence 


m, no 


of lim Xm» for any m (cf. Xun = (—1)"/m). 


n> 


Theorem 4.71 has an immediate corollary. 
Theorem 4.72. Suppose that (i) for each m, lim Xm, exists and, for 


each n, lim Xm, exists, (ii) lim Xp exists. Then lim (lim X,,) and 


m0 mM, no m2 no 


lim (lim X,) exist and are equal. 


n> m—r00 


Illustration (ii) shows that lim (lim x,,,) and lim (lim Xmn) May 


mo n> nro 
well exist without being equal. The inversion of successive limiting 
operations is generally a delicate matter; there is one simple criterion, 
of monotonicity, which we now give. 
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Theorem 4.73. Suppose that each Xj, is real and that, for each m, 
Ximn increases (decreases) withn and, for each n, Xn», increases (decreases) 
with m. If one of the limits 


Lim Xeags lima Clim: A n)s lim (lim Xn) 
m, neo ‘m0 n+ 0” mr 


exists, then the other two also exist and all oe limits are equal. 


Proof. We may assume that x,,, increases with m and n. 

(i) Suppose that X;,, > x as m,n — oo. Then X_, < x for all m,n 
Hence, for each m, (Xmi; Xmas »--) is a bounded increasing sequence 
and so lim x,,, exists. Similarly lim x,,, exists. It now follows from 


n> ‘m-—+00 

theorem 4.72 that lim (lim x,,,.) and lim (lim X,,) exist and are 
mo no n> Mr 

equal to x. 


(ii) Suppose that lim (lim x,,,) exists. Let 


mo n+o 


lim Xin = Yn Om = 1, 2, ..:) 


no 


and let lim y», = y. Since x;, increases with n, Xn < Ym for all 
m0 


nz and since Xp, increases with m, y,, increases with m also and so 
Vm < y for all m. Thus eae Sie 


for all m, n. It is easy to see that a bounded double sequence which 
increases with each index converges (exercise 4(g), 5). Therefore 
lim Xn exists. By (i), jim Gim Xmn) also exists and all three limits 


m,n 


are equal. | 


The notion of a double limit is applicable to functions on R? (i.e. 
functions of two continuous real variables). For a given function f, 
we may consider f(x, ) as x, y tend to infinity or to a finite limit. 
Also one variable may be continuous, the other confined to integral 
values. In all these cases analogues of the last three theorems hold. 


Double series. Given the double sequence (u,,,) of complex terms, 


let mon 
=> uy Cn, = 1,2, .-.). 


i=1j=1 
If Sian > SAS M,N > 00, we say that the double series 


converges to s. 
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Theorem 4.71, interpreted for double series, takes the following 


© 5 
form: If Um, converges to s and, for each m, YS ump, converges, 
mn=1 at 


© / © 
then > ( bu Unn) converges to s. We use the series form of theorem 
1 


m=1 \n= 


4.73 to prove a more general result. 


Theorem 4.74, Let (mn) be a double sequence of complex terms. If 
one of the series 


« © / @ 2 /@ 
B Waal ¥, (E btmnl)> 3, (3, mel) 4-73) 
m,n=1 m=1 \n=1 n=1 \m=1 
converges, then all the series 
o wo / o wo / @ 
Se ee ee 
m,n=1 m=1 \n=1 n=1 \m=1 
converge and have the same sum. 
Proof. 
(i) First suppose that the w,,, are real. Let 
Pmn = (|Umn| +tmn)> — Imm = 4(|Uemn| = Ymn); 
so that Pn aNd Gny are non-negative, Un = Pmn—Inn and 
0 < Pmns Imn < |Umal- 
If now one of the series (4.73) converges, so does the corresponding 


series With |tm,| replaced by Py», (by the comparison principle or its 
extension to double series—see exercise 4(g), 6). Then, by theorem 


4.73, © o oy © o 
ees (oe) eee oe 
m,n=1 m=1 \n=1 n=1 \m=1 


all converge and have the same sum. This is also true for the corres- 
ponding series of g’s and so subtraction gives the result for series of 
real terms. 

(ii) When the u,,,, are complex, let 


Umn = Van +iWmns 
Where Van ANd Wy», are real. Since 
Pmnls [Wmnl < |4mnl> 
if one of the series (4.73) converges, then the corresponding series 
With |2nn| replaced bY |Y»n| and |Winn| also converge. Hence, by (i), 


the real and imaginary parts of u,, have the desired property and 
this proves the theorem. | 
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Exercises 4(g) 
1. Find, when they exist, the double limit lim 2m, and the repeated limits 


m,n 
lim (lim Xn), lim (lim Xmn) of the sequences (x,,,) with the following 


m+n no n—-2 mo 


(m, n)th terms. 


. mn .. mtn 

% m+n’ a “mm” 

fn PEO , Winey fra! 

(iii) mean? Gy) (1s (+i). 
mn sarseptte ial 

o ww) (-ne? (142). 


2. Give an example of an unbounded, convergent double sequence. 


3. Prove, without using double limits, that if xmn increases (decreases) with 
each of m and n, then the existence of one of lim (lim Xn), lim (lim Xm») 


m>o no no m—>o 


implies the existence of the other and also the equality of the two limits. 


4. General principle of convergence. Show that a necessary and sufficient con- 
dition for the (complex) double sequence (xn) to converge is that, given e > 0, 
there is an mp such that |Xmn—Xmn'| < € if m, m’, n,n! > No. 


5. The double sequence (Xmn) of real numbers is bounded and Xmn increases 
(decreases) with each index. Prove that (xm) converges, 


6. Comparison principle. Suppose that SY) Umn. SX) Umn are double series of 
m,n m,n 
positive terms, that umn < Umn for all m,n and that >) vm» converges. Show 
m,n 
that >) umn converges. 


mn 
7. The double series SY) umn of complex terms is said to converge absolutely if 


mn 
XS |4mn| converges. Show that an absolutely convergent double series converges. 
mn 


8, Show that the double series = ) —L 
mn=1mn 


converges if and only if k > 1 and/ > 1, 
9. Show that the double series 
eo 
1 
m,n=1 (n+ nye 
converges if and only if k > 2. 
o 
10. The double series ) umn converges absolutely and, for r = 1, 2, ... 
m,n=1 


y= DD Unn = Uy, part Ua, rat eee F Up 
mtn=r 
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Prove that Le= DY ton 
r=1 m,n=1 
Deduce that, for k > 2, 
: < 1 hig! 


11. Let @, w’ be non-zero complex numbers such that w/w’ is not real. Show that 
the double series ss 1 
m,n=1 (mo+ nw’) 


converges absolutely if and only if k > 2. (For the present, & must be rational; 
general complex powers are introduced in chapter 10.) 


Ee 

12. Prove that the double series 5) z™”" converges absolutely for |z| < 1. 
m,n=1 

Hence prove that, when |z| < 1, 


z ad ee s zi +2") 


n=tl—z" ney 1-2 


o 
13. The series > az" and > b,z* 
1 


both have radius of convergence R (> 0). Their sums are denoted by f(z) and 
g(z) respectively. Establish, in a disc to be specified, the formula 


E arate) = 5 daft. 


NOTES ON CHAPTER 4 


§4.1. The first mathematician to use the O,o notation systematically was 
E. Landau (1877-1938). P. Du Bois-Reymond (1831-89) had previously used a 
more elaborate notation (which included ~) for comparing the rates of growth of 
two increasing functions which tend to infinity. (See G. H. Hardy, Orders of 
Infinity (Cambridge, 1910).) 

§4.2. The upper and lower limits of a sequence of real numbers could be 
defined as the largest and least numbers, respectively, to which subsequences 
converge (with suitable provision for infinities). However this procedure would 
require an initial proof that such numbers exist. The method we have adopted, 
though less intuitive, is technically simpler. 

Filters. In analysis the idea of a limit appears in many forms each of which is 
usually treated individually. In this book we have separately defined limits of 
sequences in metric spaces and of functions from one metric space into another, 
and other instances occur in C1. This approach, apart from being traditional, is 
best suited for an introductory account and we have again adopted it for defining 
the several different guises in which upper and lower limits appear. However a 
unified treatment of the limit process is possible. 

Let X be a non-empty set. A non-empty set F of subsets of YX is called a 
filter on X if the following conditions are satisfied. 
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Fl. If A, Be F, then An Be F. 

F2. If Ac Fand B >A, then Be F. 

F3. o¢F. 
Note that, by F2, X ¢ F. It is easy to give examples of filters. 

(i) In P, the set of positive integers, the sets A such that P—A is finite form 
a filter. 

(ii) In R', the collection of all sets A which contain an interval (x, 2) is a filter. 

(iii) Let (Xo, p) be a metric space, let a be a fixed limit point of Xo and let 
X = X)—{a}. A filter on X may be defined as the collection of all subsets A of X 
which contain a set B(a; r)—{a} for some r > 0. 

(iv) Let F be a filter on a set X. If Ae.F, denote by .o/ the subset of F 
defined by 

of ={EEF\E> A}. 


Then %={Bc AB > A for some Ae F} 


is a filter on F. 
Now let F bea filter on a set X and let (Y, 7) be a metric space. We then say 
that 
lim f(x) = Yo 
F 


(where yy € Y) if, given € > 0, there is an A € F such that o(yo, f(x) < € for 
allxe A. 

Clearly the filter in (i) yields the limit of a sequence of points in (Y, 7); and it 
is easy to see that (ii) and (iii) lead to other familiar situations. For instance if, 
in (iii), X = (a, ©) or (—%, a), we obtain a one-sided limit at a. 

By formulating the limit concept in such generality one sacrifices, not sur- 
prisingly, some of the properties traditionally associated with limits. However 
these may be restored by the imposition of quite mild restrictions on Y. 

Finally, let f be a bounded, real-valued function on a set X equipped with a 
filter F, Then the relation 


(A) = sup f(x) (Ae F) 
red 


gives a bounded real-valued function ¢ on F and it may be shown that lim 4(A) 


a 
exists, where ¥ is the filter on F defined in (iv). This limit is defined as the upper 
limit of f with respect to .F, i.e. 


lim sup f(x) = lim (sup f(x); 
F G «ea 

and similarly lim inf f(x) = lim (inf f(x). 
Fd G red 


In this sketch we have not considered infinite limits of real-valued functions. 
These present no problems of definition, but they are most simply incorporated 
in the theory of filters when topological rather than metric spaces form its back- 
ground. A simple account of filters in this setting is given by F. Smithies in his 
expository article ‘Abstract Analysis’ (Mathematical Gazette, 35 (1951), 2-7). 
The equivalent theory of directed sets is also mentioned in this paper. Still another 
general theory of limits is described by E. J. McShane in Studies in Modern 
Analysis (edited by R. C. Buck), 
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§4.3. In Cl and so far in this book no formal definition of the infinite series 
5 un has appeared. To fill this gap we write 
Sn = Ut... +Un (mn > 1) 
and say that the series is the ordered pair of sequences ((u,), (S;)). 
There is no confusion in practice in the double usage of the symbol tu 


first as designating the series formally defined as ((u,,), (s;,)) (without any implica- 
tion as to its convergence), and secondly as the number which is the sum of this 
series when it does converge. 

Similar remarks apply to double series. 


5 
UNIFORM CONVERGENCE 


5.1. Pointwise and uniform convergence 
Consider a sequence of functions 


bf Mera (all 2, :); 


where (Y, @) is a metric space. For the moment the space X need not 
carry a metric. 
Suppose that there is a function f: X > Y such that, for each x 


in X, o(fr(x), f(x) > 0 


as n > co, We then say that (f,,) converges to f on X, or, more speci- 
fically, (f,,.) converges pointwise to fon X. 


Illustrations 
In each of these, ¥ is a subset of R' and (Y, ) is R' with its usual metric. 


po nx 
@ fi@) = Ty forx > 0. 


Sx) > x. 
Wi) f(x) = x" forO<x <1. 
filx) + f(x), where f(x) = 0 for 0<x<1 and f(1) = 1. 


nx 
1+n°x* 


S(x) > 0. 


for x > 0. 


Gi) iG) = 


We observe that in (ii) the sequence of functions f,, each con- 
tinuous on [0, 1], has a limit function which is discontinuous at the 
point 1. In this example pointwise convergence is not a strong 
enough requirement to ensure that continuity is carried over from 
the functions f,, to the limit function /. 

The central theme of this chapter is the transmission of properties 
of the individual functions of a sequence to the limit function. For 
this investigation we define a mode of convergence of a sequence 
of functions, stronger than pointwise convergence. 
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Definition. Suppose that f,,: X -> Y is a sequence of functions on a 
set X to a metric space (Y, a). The sequence (f,) is said to converge 
uniformly tof: X + Y if 


sup o(f, (x), f(x)) +0 as n>, (5.11) 


The distinction between pointwise and uniform convergence is then 
that, in the former o(f,,(x), f(x)) tends to 0 as n - co for each separate 
point x and, in the latter, the supremum of all these values tends to 0. 
It is plain that uniform convergence implies pointwise convergence 
(to the same limit function). Illustration (ii) shows that convergence 
may hold at every point of a set, here [0, 1], but since, for every n, 


oe, |fxl) —f09| = 1, 


the convergence is not uniform. 

The e-N criterion for the condition (5.11) is often useful. Converg- 
ence for each separate x in X means that, given ¢ > 0, there exists 
N = N€, x) such that o(f,(x), f(x)) < ¢ for all n > N. The con- 
vergence is uniform if and only if it is possible to choose N = N(e), 
independent of x, such that 

o(f,(x), f(x) < € for alln > Nand all xe X. 

We shall examine the illustrations (i), (ii), (iii) for uniformity of 
convergence. Since ¥ < R! and Y = R', they lend themselves to 
graphical representation. If f,, +f uniformly on X, the graph of 
y =f,(x) for all n greater than N(e) lies inside the strip of the (x, y) 
plane between the curves y = f(x)+e and y = f(x)—e«. The fact 


oe 
yale 
y=/fQ) 


evaf(y—e 
’ 
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that pointwise convergence does not imply uniform convergence 
means that the eventual nearness of f,(x) to f(x) for each individual x 
does not imply the eventual ‘global’ nearness of the curve y = f,(x) 
to the curve y = f(x). 

In (i) above, f(x) —/(x) = —2?/(n+.x). In any finite interval, say 


0, al, 
eo sup | f(x) —f(@) < 
O<r<a 


and so f,, >f uniformly on [0, a]. 
Suppose, however, that x is free to take any value in [0, 0). Since 


sup | fn(x)—S(@)| = 2, 
x>0 


the convergence is not uniform in the infinite interval [0, 00). 

(ii) We have already shown that the convergence of (x”) is not 
uniform in [0, 1]. This fact is also intuitively clear. The limit function 
fhas a jump of amount | at the point | and so, ife < 4, none of the 
continuous curves y = x” can lie in the two disconnected pieces 
represented by f(x)—e < y < f(x)+¢(0 < x < 1). It will be proved 
in theorem 5.21 that any sequence of continuous functions with a 
discontinuous limit must converge non-uniformly. 

The reader should prove that in any interval [0, 1-46] which 
excludes the point 1 the convergence of x” to its limit is uniform. 

(iii) This example is more subtle than (i) or (ii). The function f,, 
has a maximum at the point 1/n and f(1/n) = 4. We see that 


sup |f,(x) —f()| = 4 
x20 


and the convergence is not uniform. 


a 
=O as’ n>, 
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Each f,, is continuous everywhere in [0, 00) and so is f. Thus uni- 
formity of convergence is not a necessary condition for the limit 
of continuous functions to be continuous. 


Another example exhibits the notions of pointwise and uniform convergence 
in a more abstract setting. 
Let C be the set of continuous and bounded real functions on R' and let p be 
the metric defined by 
eG, ) = sup 


-o<r<0 
O<h<1 


(¢, ve C). 


+h 
ih {d(t)— W(t)} dt 


(It was shown in exercise 2(a), 2 that p is a metric.) 
For n > 1, we define the functions f,,: C > C by 


SlP)(x) = («+2) (gE C, xe RY). 


Now take any ¢ € C and let Ky = ee |d(x)|. We have 
nek? 


L"fo(-))-20 a 


t+h+(1/n) e+ (1/n) 
ih wade f wnat 


PU(A), ¢) = sup 


-w<2<0 
0<h<1l 


= sup 
-o<r<0|Jrth 
0<h<1 


<2 K,+0 as n>, (5.12) 


So, for all EC, f,(¢)>¢ as n>; in other words, f, > J pointwise, where J is 
the identity function on C (i.e. 1(¢) = ¢ for all 6 C). It also follows from 
(5.12) that, if K is any positive number and Cx is the subset of C consisting of all 
¢ such that Ky, < K, then 


sup p(fu(d), 1(¢)) < 
geCk 


iN 


K. 


Hence f, > J uniformly on Cx. 


We add three further notes, 
(1) In the two paragraphs preceding theorem 3.44 the usual metric 
in the space B(X, Y) of bounded functions f: ¥ >(Y,o) was 


bees ACF, 8) = sup o(f(2), g(2)). 
Thus, for functions in B(X, Y), uniform convergence is identical 


with convergence in the metric space (B(X, Y), p). 
If, in particular, Y is R', then 


e(f 8) = sup If) -g0)| 


and, for bounded real valued functions, uniform convergence is the 
same as convergence in the metric space (B(X), p). 
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(2) We have assumed the set of functions on X to Y to be indexed 
by a positive integer n which tends to oo. It is easy to adjust the 
definition of uniform convergence to cover, say, a double sequence 
indexed by (m, ) or a set of functions determined by a continuous 
variable ¢ which tends to a limit f or to «0. 

(3) Convergence and uniform convergence of series. 

A statement about convergence ofa series }) u,, of real or complex 

n=1 
valued functions on a set X is a translation of the corresponding 


n 
statement about the sequence s,, where s, =  u,. 
r=1 


Illustration. For n > 1, let u, be defined on the set of complex numbers z 
satisfying |z| < 1 by Or 
1-2 
1-— 


co 
and >) wu, converges to s at each point of the disc |z| < 1. 
T 


Then Sn(Z) = 


1 
Shape s(z), say, 


The convergence is not uniform because, for every 7, 


sup |ss(2)—s@I = sup |"; 


The convergence is, however, cn on |z| < 1—6, where 6 is any fixed 
positive number. For we have 


a-syr 
sl 
per Soars 


Theorem 5.41 will show that any power series converges uniformly on a closed 
disc inside its circle of convergence. 


>0 as n>, 


Exercises 5(a) 
1. The functions f,, fon XU Y are such that f, > f uniformly on X and f, >f 
uniformly on Y. Show that f, > f uniformly on Xu Y. 


2. If complex valued functions f,, g, tend respectively to f, g, uniformly on X, 
show that, for any constants «, £, af,+fg, > of+fg uniformly on X. Is it 
necessarily true that f, g, > fg uniformly on X? 


3. The sequences (f,) on [0, 1], (g,) on (0, 1), (A;,) on [0, 100] are defined by 
sin nx 


(x) = x"1-x), Bn) = saat A(x) = 


a 


Prove that all three sequences converge pointwise; which of them converge 
uniformly ? 


4, Examine for uniformity of convergence on [0, 1] the sequences (f,), (gn) 
—— fla) = 31-2"), gs) = mem, 
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5. Let (r,) be a sequence consisting of all the rational numbers and, for 
n= 1,2,... define the functions /, on R' by 
1 ifx=n, 
n(x) = { , 
Inha) 0 otherwise. 
Prove that (f,) converges pointwise, but not uniformly on every interval of R'. 


6. Let Q be the set of rational numbers in (0, 1) and define the function f on Q 
by f(p/q) = 1/q when p,q are coprime positive integers. Let (r,) be a sequence 
consisting of the members of Q and, for n = 1, 2, ..., define f, on Q by 


(FQ) if XE fr, -..5 nds 
0 ifxe Q—{ry, wes nk 


Show that f, -> f uniformly on Q. 


T(x) = 


7. Examine for pointwise and uniform convergence the sequences (/;,), (gn), (An) 
of complex functions defined by 


sin nz 
a 


a he h 

ae = en ame 
2) > &n(z) =e", hy(z) 
8. It is given that, for every continuous real function f on [0, 1] for which 
(0) = 0, the sequence (f5,,) converges uniformly on [0, 1]. Also lim s,,(0) exists. 


noo 


Decide whether the sequence (s,,) must converge uniformly on (0, 1]. 


SZ) = ( 


9. For n = 0,1, 2, ..., the functions un, Yn, Wn on [0, 1] are given by 
U(x) = x"(1—x),  On(x) = x"(1—x)*, wax) = (— Dx" — x). 


Prove that the series = u,, £v,, = w, all converge pointwise; which of them 
converge uniformly? 


10. Let X¥ < R® be the rectangle [a, b] x [c, d], where a > 0, c > 0. The functions 
Jy: X > R} are given by 


Show that (f,) converges uniformly on X. 


11. The set ¥ consists of the real functions ¢ on [a, 6] such that on [a, 6] 


(i) 9’ exists and is continuous, and 
Gi) 190], 19’@)| < M. 
For n = 1, 2, ..., the functions f,,: ¥ > R! are defined by 


b 
SAG) = ) (x) sinnxdx (pe X). 
a 


Prove that the sequence (/,,) converges uniformly on X. 


12. Let (X, p), (Y, 7) be metric spaces. Let X, be a subset of X and xp a limit 
point of X,. Suppose that the functions f,: X>) > Y converge uniformly on Xo 
and, for each n, 

SAX) > Yn AS XX 


Show that, if (Y, 7) is complete, then the sequence (),,) converges. 
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5.2. Properties assured by uniform convergence 


Illustration (ii) of §5.1 shows that the limit function of a sequence 
of continuous functions may be discontinuous. We now prove that 
this cannot happen when the convergence is uniform. 


Theorem 5.21. Let (X, p) and(Y, 0) be metric spaces. Let the sequence 
of functions f,,: X - Y converge to f, uniformly on X. If c is a point 
of X at which each f,, is continuous, then f is continuous at c. 


Proof. (The argument is essentially the same as was used in 
theorem 3.45.) 
Given e > 0, there is n such that 


sup o(fr(x),f()) < €. 


Since f,, is continuous at c, there is a d > 0 such that 
o(f,(x),f,(c)) < € whenever p(x, c) < 0. 
Hence, if (x, c) < 6, 


oF) LO) < FF), fx) + (Pi), LA) + 7PnlO), LQ) < 3€ 


and so f is continuous at c. | 


Corollary. If the series Xu,, of real or complex valued functions con- 
verges uniformly to s on (X, p) and if each u,, is continuous at c, then 
s is continuous at c. 


Proof. Each s, = u,+...+u, is continuous at c. | 


The hypothesis of uniformity of convergence which has been 
proved in theorem 5.21 to be a sufficient condition is not a necessary 
condition. This is shown in illustration (iii) of §5.1. We shall prove 
in theorem 5.35 that, if Y is R' and if the sequence (f,,) is monotonic, 
then uniformity of convergence is necessary for the continuity of f. 

Repeated limit problems. In theorem 5.21 continuity of f at ¢, 
when c is a limit point of X, means that 


lim f(x) = S(0). 


The left-hand side is lim lim /,,(x), where the inner limit is in the 


ae no 


metric and the outer in the p metric. The term f(c) on the right-hand 
side is lim f,,(c), and, if each /,, is continuous at c, this is the same as 


n> 


lim lim f(x). 


n>2 2c 
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Hence the conclusion of theorem 5.21 is that in whichever order 
the two limiting operations 
lim and lim 
no 20 
are applied to /,,(x) the result is the same. 

The problem of inverting the limits m > oo and n > oo in a double 
sequence has already been discussed in §4.7; the solution there lay 
in the sequence being monotonic in m and inn. 

A common application of the notion of uniformity is to justify 
the inversion of the order of repeated limits. Theorems 5.22 and 5.23 
will provide further instances of this. The reader will see that it is 
appropriate to specialize the arbitrary metric spaces of theorem 5,21 
to the space R14. 

We consider sequences of real functions integrable over a finite 
interval. A pointwise convergent sequence of this kind need not have 
an integrable limit function; and, even if the limit function has an 
integral, the sequence of integrals need not converge to it. 

To justify the first statement we take a sequence of functions f,, on 
[0, 1] defined as follows. If (r,,) is a sequence consisting of all the 
rational numbers in [0, 1], let 
UPS Re Fp SN Oe 


Srl) = | 
Then f,, >f, where 
F(x) = { 


0 otherwise. 


1 if x is rational, 
0. if x is irrational. 


Now each function f,, is integrable over [0, 1], since every lower sum 
s(Z) is 0 and the upper sums S(Z) tend to 0 as the length of the 
largest subinterval of Z tends to 0 (see C1, 123), However f is not 
integrable over [0, 1] (see C1, 122). 
For the proof of the second statement take the sequence of 
functions g,, on [0, 1] where 
n(x) = nxem™, 


&n > g pointwise, where g(x) = 0 for0 < x < 1. Also 
1 
fj galsdax = 0 -e) 4, 


1 
while i g(x)dx = 0. 
0 
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It is left to the reader to show that neither of the sequences (/,,), 
(g,,) converges uniformly (cf. exercises 5(a), 4, 5). 


Theorem 5.22. Let (f,) be a sequence of real functions integrable over 
the finite interval [a, b]. If f, >f uniformly on [a, b], then 

(i) f is integrable over [a, b], and 

b b 
Gi [nafs 
Proof. Given ¢ > 0, let N be such that 
sup |f,(x)-f(x)| < € for n>N. 
asarsb 


@) Fora<x<b, 
Sy(x)-€ < f(%) < fy) +e 
and so, when @ is any dissection of [a, 5], 
s(B, fy) -—&(b-a) < (Df) < SD,f) < SD, fy) +e(b—a). 
Thus S(9,f)-9(D,f) < SG, fy)-—\D, fy) +2e(b—a). 
But, since fy is integrable over [a, 5], 
SQ, fn) -(D.fx) < € 
if the length of the largest subinterval of @ is sufficiently small. For 
Bhs, SO,f)-,f) < {1 +2b-a)] 


and therefore f is integrable over [a, 5]. 
(ii) For n > N, by Cl, 127 (5), 


| fin-fir] =| G7] < -a. | 


Corollary. (Term-by-term integration.) If Zu, converges uniformly 
to s on [a, b] and if each u,, is integrable over [a, b), then s is integrable 


and ‘i . 
fis-2 fim. 


We note that uniform convergence is not necessary for the validity 
of term-by-term integration; this is shown by illustration (ii) of §5.1. 

Theorem 5.22, proved for a finite interval, is false for an infinite 
interval. (See exercise 5(b), 5.) 

In the last two theorems of this section we deal with sequences of 
functions differentiable in an open or a closed interval. When the 
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interval is closed, derivatives at the end points are taken to be one- 
sided: if the interval is [a, b], f’(a) and /’(b) are defined by 


Feo) = jig RAE pO) = jin DEED. 


Theorem 5.23 A. Let (f,) be a sequence of real functions differentiable 
on a finite closed interval [a, b]. Suppose that (f,(x)) converges for at 
least one x € [a, b] and that (f;) converges uniformly on [a, b]. Then 
(i) (f,) converges uniformly on [a, b), 
(ii) f = lim f, is differentiable in [a, b| and, for all x € [a, b), 
n> 


F(X) = lim fn). 
Proof. Let lim f; = g and take any e > 0. Since (f;,) converges 
uniformly on ee there is an N such that 
sup |fr(x)—g(x)| <¢ for n>N (5.21) 
and therefore ay 
oP, |fxl) —fn(x)| < 26 for m,n > N. 
If then &,, & are any points of [a, b], we have by the mean value 
theorem for f, —fins 
n(E) Sn ED} — nla) Fin Ea)} = (G1 — G2) (Fn) —Sn( Ss 
where & lies between £, and &,; and so, for all m,n > N, 
[FnlEs) Sin Ex)} — Ufn(E2) —fn(E2)}] < 2|€1—-Eele. (5.22) 
(i) If xq is a point for which (f;,(xo)) converges, there is an N’ such 
met [ful%) —Sn(%a)| <€ for m,n > N’. / (5.23) 


Now let x be any point of [a, 6]. By (5.22) with £; = x and & = x9 
and by (5.23) we have, for m,n > max (N, N’), 
|fxC)—Snl2)| < (1+2|x-x9l)e < {1+2(b-a}e (5.24) 


and so lim f,,(x) exists for all x € [a, b]. Letting m — co in (5.24) we 
see that (f,) converges uniformly on [a, 5]. 

(ii) Let ¢ be an interior point of [a, b] and take any A + 0 such 
that c+he [a, b]. By (5.22), with £; = c+ and & = c we have, for 


m,n > N, ~ > 
fer WL) Sele DLO) ¢ 20, (5.25) 


. 
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Since Fle +h) —fnlo) > fle +h) fo) 

as m > 00, (5.25) shows that, for all h+0 such that c+h€ [a, 6], 
flee D—L00)_fle+ LO 


<2e for n>WN. (5.26) 


By the definition of the derivative f\(c), there is an 7 > 0 such that 
h)- , 
|faule+ - 7) fic) 
i) 


<e when 0< |h| < 9. (5.27) 


Then, by (5.26), (5.27) and (5.21), 
e+ FO xe) | 


Sylo+ » —fn(o) — filo) 


é 4 (c+ w LO _fxle+H=-ful)| , 
= h 


+|frO-sOl 


< 4e 
when 0 < |h| < 7. It follows that f’(c) exists and is equal to 
g(c) = lim f,(c). 


If c is one of a, b, the above proof applies except that h must be 
restricted to either positive or negative values respectively. | 


In dealing with open intervals we can assume rather less than 
uniform convergence on the whole interval. 


Theorem 5.23B. Let (f,) be a sequence of real functions differentiable 
in a finite or infinite open interval (a, b). Suppose that (f,(x)) converges 
for at least one x € (a,b) and that (fn) converges uniformly on every 
finite closed subinterval of (a, b). Then 

(i) (f,) converges uniformly on every finite closed subinterval of 
(a, 6), 

(ii) f = lim f,, is differentiable in (a, b) and, for all x € (a, b), 


f°) = lim fuG. 
Proof. Let x» be a point such that (f,,(x9)) converges, let c be any 


point of (a, b) and let [~, 4] be any finite, closed subinterval of (a, b). 
There is now a finite, closed subinterval [p, q] of (a, b) such that 


Xo, c¢€(p,q) and [x, 4] < [p,q]. 
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Then, by theorem 5.23A, (f,,) converges uniformly on[p, g] and hence 
on [«, A]. Also, if f= lim/,, then f’(c) exists and is equal to 
lim fn(c). | 


Notes. (1) We can rewrite 5.23A and B as theorems on the term- 
by-term differentiation of infinite series. 

(2) The uniformity of convergence of (f;) is not a necessary 
condition that f(x) = lim /;(x). A counter-example is provided by 
exercise 5(b), 7. 

(3) The proof of theorem 5.23A is hard. If, however, we add to 
the hypothesis the requirement that each f; is continuous, the 
theorem is easily deduced from theorem 5.22 as follows: 

By theorem 5.21, f; tends to a continuous limit function, g say. 

By theorem 5.22, 

fis = im [ix 


a ne Ja 


lim (fue) -fu(@)} 
$0) -f@). 


Since g is continuous, the left-hand side has derivative g(x). Hence 
g(x) = f"(x), as proved in theorem 5.23A. 

(4) Each of theorems 5.22 and 5.23 exhibits uniformity of con- 
vergence as a sufficient condition for inverting two passages to a 
limit. Differentiation and integration are both limiting operations 


'b 
(the integral [ f being the limit of approximative sums—C1, 123). 
a 


The conclusions of the theorems are respectively 
ee _ 
J (lim f,) = tim ff 
a n> no Ja 
de Pec 4 
and Te dim ful) = lim FS) 
or, expressed as term-by-term differentiation of series, 


d oO o 
FEM) = Bm). 
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Exercises 5(6) 
1. Show that the series SE x(—x") converges pointwise, but not uniformly 
on the interval [0, 1]. ‘ 
2. The function f, on R! 1s given by 


fie) = 


1+x"" 


Show that (/,,) converges uniformly on the interval [a, 5] if and only if [a, 6] does 
not contain either of the points 1,—1. 


3. The real function ¢ on [0, 1] is continuous and f, on [0, 1] is defined by 
Sulx) = x"9(x). 
Prove that (f,) converges uniformly on [0, 1] if and only if A(1) = 0. 


4. Give examples to show that a sequence of integrable functions with an 
integrable limit function may be such that the sequence of integrals (a) diverges 
to 00, (b) oscillates finitely. 
5. (i) Construct a sequence of functions f, converging uniformly to a function f 
co 120 
on an interval [a, ©] such that f, exists for each n, but i) Ff does not. 
a 


ii) Construct a sequence of fanetions &n converging uniformly to a function g 


on an interval [a, 0) such that [” San = 1, 2, ...) and [” g exist, but 
a 
ipae( 
a a 
6. The functions f, on [0, 1] are given by 
F(x) = (p > 0). 


Find for what values of p the sequence (f,) converges uniformly to its limit /. 
1 


if ae 


1 
Examine whether f Te ah f for p = 2 and for p = 4. 


7. The functions f, on [0, 1] are given by 


nx? 
Sr(x) = Tea" 


Show that the sequence (/f,) does not satisfy all the conditions of theorem 
5.23 A, but that the derivative of the limit function exists in [0, 1] and is equal to 
the limit of the derivatives, 


8. The functions f, on [—1, 1] are defined i. 


I) = 


T+nxt = 


Show that (/,) converges uniformly and that the limit function fis differentiable, 
but that the relation f(x) = lim f(x) does not hold for all x in [—1, 1]. 
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9. The functions f, on [0, 2] are given by 
Sox) = (+x")¥". 


Prove that the sequence of functions /,, differentiable on [0,2], converges 
uniformly to a limit function which is not differentiable at the point 1. 


5.3. Criteria for uniform convergence 


Uniform convergence of a sequence or series of functions can 
often be established by an extension of a criterion for the convergence 
of a sequence or series of numbers. 


Theorem 5.31. (General principle of uniform convergence.) A necessary 
and sufficient condition for the sequence (f,) of real or complex valued 
functions on the set X to be uniformly convergent is that, given é > 0, 
there is an m such that 


sup \Fn(x) —fn(x)| < € whenever m,n > nN. (5.31) 


Proof. 
(i) If (f,) converges uniformly to fon X, then, given ¢ > 0, there 
is an mp such that 


Bu |frl) -f0)| < de when n> 1% 


and (5.31) is an immediate consequence of this. 

(ii) Suppose that, for every ¢ > 0, there is an mp such that (5.31) 
holds. Then, for every x, the sequence (f,,(x)) of real or complex 
numbers is a Cauchy sequence and so, since R! and Z are complete, 
lim f,,(x) exists. Thus there is a function fon X such that 
n+ 


S,(x) >f(x) for every xe X. 


We shall show that f,, > / uniformly. 
Take any ¢ > 0 and let m be such that (5.31) holds. Now let x 
be any point of X¥. Then, when m, n > MN, 


\Fnl) —fn(*)| < € 


and so 


[Pe)~fa(2)| = lim [fn(2)—La(0)] <€ for n > Mo 


Since this holds for all x € X, 


sup [/3)—f,@)] < © for n> np 


Therefore f,, >/f uniformly on X. | 
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It will be noticed that the proof of the sufficiency is merely part 
of the proof of theorem 3.44 on the completeness of the space 
BUX, X): 

We shall now use theorem 5.31 to establish a number of con- 
ditions ensuring the uniform convergence of series of functions. 


Theorem 5.32. (Weierstrass’s M-test.) Let the functions uy, Ug, ... on 
X be real or complex valued. If, for each n, there is a constant M,, such 
ee |u,(x)| <M, (eX), 
where =M,, converges, then Xu, converges (absolutely and) uniformly 
on X. 
Proof. Let s, = t,+...+U,(n = 1, 2,...). Since 2M,, converges, 
given € > 0, there is an m such that 
Myyit..-+My <€ whenever m>n2> MN 

Hence, for m > n > MN, 

sup |s,,(x)—Sn(X)| < Mysit-..+Mn < € 

reX 


and so, by theorem 5.31, Zu, converges uniformly on X. | 


The M-test can serve only for absolutely convergent series. 
Theorems 4.53 and 4.54, however, have useful analogues for series 
which are uniformly but not absolutely convergent. 


Theorem 5.33. (Dirichlet.) The functions a,, V, on X are real valued 
and satisfy the following conditions: 


(i) the sequence s(x) = y a,(x) is uniformly bounded on X, (i.e. 
ret 


there is a constant H such that \s,(x)| < H for all n and all x € X); 

(ii) for each x, (v,(x)) is a monotonic sequence; 

(iii) v,(x) + 0 as n+ 0, uniformly on X. 
Then Xa,v,, converges uniformly on X. 

Proof. By (i), for k > 0 and all xe X, 

lana) +... + Ay in(X)| = [Snax —5,(x)| < 2H. 

Let X¥ = X,U Xe, where, as 7 increases, v,(x) decreases for x © X; 
and increases for x € Y,. Then, by the corollary to theorem 4.52, 
whenever p > 1, 


[an sa(X) Unga) + +0 + Ani) Pnip)| < 2A iO) 


for all xe X;. Since v,(x) +0 uniformly on X;, it follows from 
theorem 5.31 that the series Za,v, converges uniformly on X}. 
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Similarly the series converges uniformly on X, and therefore on 
X = X,U X, (exercise 5(a), 1). | 


Theorem 5.34, (Abel.) The functions ap, v, on X are real valued and 
satisfy the following conditions: 
(i) the series Za,(x) converges uniformly on X; 
(ii) for each x, (v,(x)) is a monotonic sequence; 
(iii) v,(x) is uniformly bounded on X. 
Then Xapvp, converges uniformly on X. 

Proof. Let M be such that |v,(x)| < M for all xe X and all n. 
Again denote by X, and X, the subsets of ¥ on which v,(x) decreases 
and increases respectively. We may take v,(x) > 0, since we could 
consider M+v,(x). By (i), given ¢ > 0, there is an my such that 

lanaa(X) +++ +Qn4n(X)| < € 
for n > m, k > 0 and all xe X. Then, again by the corollary to 
theorem 4.52, 
|a@n41(%) Pnsi(X) + + Oni p(X) Unip(X)| < €Vpsi(X) < eM 
for n > Mm, p > Oand all x € X,. Hence by theorem 5.31, La,,v,, con- 
verges uniformly on X;. Uniform convergence on X, is obtained 
similarly. | 


The above proof is independent of theorem 5.33, for the type of 
argument used to deduce theorem 4.54 from theorem 4.53 is now 
inapplicable. (Why ?) 

A particularly simple and important case of theorem 5.34 occurs 
when a,(x) = @,, (independent of x) and La, converges. 
sin nx 

nP 


Example. The series 5 
n=1 


When p > 1, by the M-test, the series converges uniformly on 
(— 00, 00). 

When 0 < p < 1, the series converges uniformly in every interval 
[a, 2] where 2km < a < # < 2(k+1)7, but not in any interval con- 
taining a point 2km (k = 0, +1, +2, ...). We prove this. 

n 
x sin rx is uniformly bounded on [a, 4] for, when a < x < f, 


re 


cos (n+4)x—cos i 1 


2 sin 4x = 


n 
|= ara ~ |sin $x] 


1 1 
i (ere ja)’ sina) 
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Also 1/n? decreases and tends to 0. Therefore, by theorem 5.33, 
X(sin nx)/n? converges uniformly on [a, £]. 

The convergence is not uniform in any interval including a point 
2k. For, when x = 2km+7/(4n), 
LAS oa | Ul kis alee in UO eee gL 
Fae Peal ements 7 4n? ~ ON pans ae an” ae 
(since sin 9 > 20/7 when 0 < @ < 4n) and the necessary condition 
of theorem 5.31 is not satisfied. This is a recognized technique for 
establishing non-uniformity. 

The last theorem of the section is a partial converse of theorem 5.21. 


an sin7x 


Theorem 5.35. (Dini.) Let (f,) be a convergent sequence of real valued 

functions on a compact metric space (X, p). If, for every x € X, the 
sequence (f,(x)) is monotonic, and if all the functions f,, (n = 1, 2, .-.) 
and f = lim f, are continuous on X, then f,, > f uniformly on X. 


Proof. Take any ¢ > 0. Given any point c € X, there is an integer 


n, such that ale) S10) < & 
Since f,,—f is continuous, there is an open ball B, with centre c such 
et [fal] < 2e 


for all x € B,. Also | f,(x)—f(x)| decreases and so 
[fr —F@)| < 2¢ 
for n > n, and xé B,. 


As X is compact, by the Heine-Borel theorem 3.7, there is a 
finite number of points c,, ..., ¢, such that the open sets B,,, ..., By, 


cover X. Hence, if N = max (Mtg «+09 Moy)s 


then |frlx) f(x) < 26 
for alln > Nand xeX. | 

By taking X = [0, 1) and /,(x) = x” we see that without the 
condition of compactness the conclusion of the theorem may be false. 


Exercises 5(c) 


1. Examine for convergence and uniformity of convergence the (real) series 
whose nth terms are 


(ii) cosech nx, (iii) ad 


(iv) e™ sinnx, (v) ((n+1)—n) cos nx, (vi) wisiy 


@) 


me 
n(l+nx*)’ 
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2. Show that the complex series 


= 1 
n=02 +n" 
converges uniformly on any bounded subset of 


Z* = Z—{.;., —2/, —1, 0; 7, 24, ...}, 
but not on Z*. 


c} Moi 
3. Show that the series > — (p > 0) 
n=l 


converges uniformly on the interval [—1, 1]. 


4. The sequence (a,,) of real numbers is monotonic and a, > 0 as n > 00, Prove 
that the power series = a,z" converges uniformly on B(O; 1)—B(1;6) (6 > 0). 


5. The functions fon (— ©, 0) and g on (1, ©) are defined by 


a(x) = Se seer 


x tn 3x2? nae 


f(x) = 
Prove that f’ and g’ exist on (— ©, 00) and (1, %) respectively, and are obtained 
by term-by-term differentiation. 
6. Let « > 0 and define u, on [0, 00) by 
a 

wale) = 1+n°x?* 

(i) Show that Zu, converges uniformly on [0, 1] if and only if « > 1. [To 

2n 

prove non-uniform convergence for a < 1 consider > u,(1/n).) 

(ii) Show that =v, converges uniformly on [0, ©) itz ota only if 1 <a <2, 

x"(1—x) 

paren log (n+ 1)" 


7. Let M, = 
Prove that =x"(1—x)/log (n+1) converges uniformly on [0, 1], but that 2M, 
diverges. 


8. Find a series Su, which converges uniformly and absolutely on an interval 
[a, 6] and is such that =|u,,| does not converge uniformly on [a, 5]. 


; 2 (=1) 
9. (i) Prove that the series DY; 
nel tx 


converges uniformly on [0, 00), but that it does not converge absolutely for any x. 
(ii) Let (r,) be a sequence consisting of all the rational numbers and define the 
functions f, on (— ©, 0) by 


fata) = | 


1 forx = ra, 

0 otherwise. 

2 1 

2 FWA =F) 

converges (absolutely) for every x, but does not converge uniformly in any 
interval. 


Prove that the series 
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10. Denote by [a] the integral part of the real number a. 


Show that the series 


noi 7° 
converges uniformly on any finite interval. Prove that the sum function s is 


continuous at any irrational point; and that, at a rational point p/q (where p, q 
are coprime integers and g > 0), 


ds)-a-) “85 


11. Prove that, for 0 < x < 1, the series 
mt 
D = sin (7x") 
nell 
converges to a function f and that the convergence is uniform in every interval 
[0,a](0 <a< 1). 
Show that the series 2 fl{ 
z= = sin (ax") dx 
n=1J0 ” 7 
converges and deduce that this sum is equal to j f(x) dx (- lim I f(x) dx) a 
0 


a—1- 


12. Tannery's theorem. The complex valued functions v9, 04, V2, --. defined on the 
set {1, 2, 3, ...} satisfy the following conditions: 


(i) for fixed r, lim v,(n) = w,, 
no 
Gi) sup |v,(n)| = M, and = M, converges. 
n>1 
Forv = 1,:2,....,let 
F(n) = vo(n) +041) +... + Pm), 
where p is an increasing function of n and P(n) > 00 as n > ©, Prove that 
© 
lim F(@n) = ¥ w,. 
no r=0 


[Define the functions uo, u1, Ua, ... on the set {0, 1, 4, 4, ...} endowed with the 
usual metric on R! by 


1 v,(n) if p(n) > r, 
uy (; = : uy(0) = Ww, 
n 0 ifpi)<r; 

and use the corollary to theorem 5.21.] 

13. Deduce from 12 that, for every complex number z, 

; z\* 

lim (1+) = exp z, 


no 


© 
where exp z is defined as >) 2"/n!. 

n=0 
14, Sequences of monotonic functions. Each function f, is monotonic on the finite, 
closed interval [a, 5] and the sequence (f,) converges pointwise on [a, 5] to a 
continuous function f. Prove that the convergence is uniform. 
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5.4. Further properties of power series 


With the concept of uniformity at our command we can prove 
theorems deeper than those of §4.6. 


Theorem 5.41. If the power series Xa,,z" has radius of convergence R 
and0 <r < R, then Xa,,z" converges uniformly for |z| < r. 

Proof. When |z| <r, |a,z"| < |a,|r” and Z|a,|r" converges by 
theorem 4.61. The result now follows, from the M-test. | 


Theorem 5.42. The sum of a power series is continuous within its 
circle of convergence. 

Proof. Let R be the radius of convergence of Za,,z” and let zy) be 
any point such that |z)| < R. If |z| <r < R, Za,z" converges 
uniformly for |z| <r and so, by the corollary to theorem 5.21, 
Xa,,z” is continuous at Zp. | 


Theorem 5.43. (Principle of equating coefficients.) Jf Za,,z” = Xb,,2” 
Sor a sequence of non-zero values of z tending to 0 as limit, then a, = by, 
Sor all n. 

Proof. Let (z,) be a sequence of non-zero complex numbers such 

that Za,z" = Xb,z" for z = z,, where lim z, = 0. 

Suppose that the theorem is false and let a,,, b,, be the first pair of 
unequal coefficients. Then 


2™ Y Gnin—Omsn)2” = 0 
n=0 


forall z, and so E Cnin—Emtn) z~=0 
= 


for all z,. The power series clearly has a positive radius of converg- 
ence. It is therefore continuous at z = 0 and so its sum for z = Ois 0. 
Thus a,,—b,, = 0 and we have a contradiction. | 


It was proved in C1 (p. 101) that 
(3 a,z*) (3 byz") = LY (Qodat... +anbo) 2” 
n=0 n=0 


n=O 
when z lies in the discs of convergence of both Xa, z” and Z4,,2"; in 
other words, the product of two power series is obtained by formal 
multiplication. The next theorem shows that formal manipulation 
also leads to the power series of composite functions. 
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Theorem 5.44, Let 


fe) = 3 agz” (lel < B), 


ae) = 3 byz® (el < 8). 
If \bo| < R, there isap > O such that 
fig(e)) = Eenz” (lel <P, 


where the coefficients c,, are obtained by formal substitution: defining 
Pin (k,n = 0, 1, 2, ...) by 


ge) = E Pinz*, 


© 
we have Cn = YD Pen 
k=0 


Proof. 
(i) Suppose that ¢ is such that x, |b, £"| < R. Then |g(Q)| < R 
‘a 
and therefore 


FeO) = E us = 3 an peak) = 3 (E, aerent). 


If the order of the two summations on the right may be reversed, we 
have 


fe) = 3 (3, ouPat") = Beak. 
n=0 \k=0 n=0 
By theorem 4.74, this reversal is legitimate if 


3 ( 3, lavraat*l) 
k=0 \n=0 
converges. 
The power series = |b,,|z” has the same radius of convergence S as 
5,2". Let P 
We) = 3 [bale (lel < 9) 


Then hk) = z UZ"; 
a= 
where 
Gin = > [Brilter[Bngl |) Ong ss Ong ll = [Pini - 


Mt tM=N Mt NHN 
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Now & |a,|z* has radius of convergence R, 


E,aulee| = MAC) and WI) = 3, lel < ® | 


Therefore >> lax ( > dnl!) 
k=0 n=0 
converges. Since |Punf"| < Ggn|E"|, it follows that 


, lau! ( 3 lpentel) = 5 ( 3, louent*l) 
converges. 


(ii) By theorem 5.42, h is continuous in the disc |z| < S. Since 
h(O) = |bo| < R, there is therefore ap > 0 such that 


= [bn2"| = A(lz|) < R 
n=0 
for all z in the disc |z| < p. | 


Notes. (1) If by = 0, then 
Pa= 3 b,, -+» Bn, = 0 


mM 
M+..+m=N 


for k > nand so Ch = LX a Pen 
k=0 


is the sum of a finite series. 

(2) If R = ©, then the inequality = |b,,z”| < R is satisfied by all 
z such that |z| < S; thusp = S. 

We now use theorem 5.44 to obtain the reciprocal of a power series. 


Theorem 5.45. Let 
He) = az" (le] < 5). 
ke 
If x + 0, there isa p > 0 such that 
1 o 
42) =) > Bn2" (|2| <p), 
where the coefficients 2, are obtained from the equations 
af = 1, 
MP, +%,fy = 0, 
% Ba +% fy +%fy = 0, 
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Proof. In theorem 5.44 take 


fo =e ES cal < led 
and ez) = anz" (\z| < S). 
Then Ag) = 1/0) 


and 1/d(z) may be expanded in a power series 2f,,2” for all z such 
that is 
>) |onz™| < lool. 


By continuity, this inequality holds in a disc |z| < p. 

The formulae of theorem 5.44 give explicit but cumbersome 
expressions for the ,,. It is simpler to evaluate fo, Ay, Ba... SUCces- 
sively. When |z| < p, 


$ a nm = Ele = 
(3, 292") (3 or") = 00-357! 
and so, by theorem 5.43, 


af =1, Ethan = 0 (= 1,2...) | 


In the rest of this section we deal with real power series only. 


Theorem 5.46. Suppose that the real power series a,x" converges to 
F(x) in its interval of convergence (—R, R). Then 
(i) fis differentiable in (—.R, R) and 


£0) = E nay x"; 
n=1 

(ii) for |x| < R, 

fe = yn yo 
[soa = antl opti 

Proof. 

(i) By theorem 4.62, =na,, x"— has radius of convergence R and, by 
theorem 5.41, the series converges uniformly on any (finite) closed 
subinterval of (—R, R). Theorem 5.23B now gives the result. 

(ii) If x is any point of (—R, R), Za,x" converges uniformly on 
(0, x] (or [x, 0] if x < 0). Now apply the corollary to theorem 5.22. | 
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Theorem 5.47. (Abel’s continuity theorem.) If Za, converges, then 
« eo 
D a,x" > DY a, as x>l1-. 
n=0 n=0 


Proof. By theorem 5.34, Za, x” converges uniformly, say to f(x), 
for 0 < x < 1. Then by the corollary to theorem 5.21, fis continuous 
on [0, 1]. In particular, f(x) > f(1) asx >1-. | 


Example. 1-4+4-4+... = 4a. 


14-3 Cpe 
1+x3 n=0 Z 


IE |x| <a; 


Hence, by theorem 5.46 (ii), 


arc tanx = >) (SB xinth 
n=o antl 


for |x| < 1. Since © (—1)"/(2n+1) converges, 


lim are tan x = >» Sais 
z—1— ~ geo 2n+l° 


The left-hand side is arc tan 1 = 47. 


Exercises 5(d) 
1. Evaluate the following complex limits: 


oy - Lg SUN cases COS 12 CORT amin nays. 
@ lim > (i) lim > (iii) lim 
ay 2 a 


era 2 20 (e*— 1)" 
2. Find the power series expansions up to the term in z‘ of the following functions: 
@ cos (sinz), (ii) e”+9, (iii) sin (cos z). 
3. The function f on R? is defined by 


ones for x + 0, 
for x = 0. 


f(x) = 
Show that, at 0, f has derivatives of all orders, Evaluate f”(0). 
0 © 
4. Given the series >) a, and > b,, let 
0 0 
Cn = Ao bat...+anbo (n> 0). 
(i) Prove that, if Za,, 2b,, Zc, converge to sums A, B, C respectively, then 


AB = C, 
(ii) Construct convergent series Ea,, =, for which Le, diverges. 
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5. Let ao, ay, as, ... be real. 
(i) Show that, if Za, converges, then La,,/(n+ 1) converges and 


i ( : ») a > x 
MA a nenntle 

(ii) Show that, if Za,/(m+ 1) converges, then the last equation holds, though 
the integrand may be unbounded. 


6. Prove that 


1-241141 


1 
Tso mie Mga = 4a 


7. Prove that, if -1 <x <1, 


flog (1-+x)}" = 2 SY" yn, 
n=? n 


{7 +2 log (1+ y2)}. 


hi = ear e oe 
where Sm = At ztatinte 


Is the result valid for x = 1? 
8. Assume that, when a is any real number, the binomial expansion 
ie 
(1+x)* = z ( ) = 
n= 
holds for —1 < x < 1 (see Cl, 102). 
Show that, when a > 0,> (") x" converges uniformly to (1+ x)* for 


—1 <x < 1;and, when a > —1, the series converges uniformly to (1+.)* for 
—1+6 < x < 1(6> 0). (See exercise 4(f), 2.) 


9. Prove that, for |x| <1, 
coals ax: 
j ee kd 
log {x+ V(1+x*)} = x 23'245 a4670°" 
10. Prove that, for all real « and f, 


eal CP): 


5.5. Two constructions of continuous functions 


Each of the two theorems in this section carries out the construction 
of a continuous function which is to have an assigned property. The 
method is to build up a uniformly convergent series of approximating 
functions designed to induce the required property in the limit 
function. 

A continuous, nowhere differentiable function. It is easy to construct 
a continuous function which fails to have a derivative at the points 
of a finite or a countably infinite set. The extension to an uncountable 
set is more difficult. 
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Lemma. Let f be a real function bounded on (— 0, 0). If 
LO-f@) 


c-x 
is unbounded, then f'(c) does not exist. 


Proof. Let |f(x)| < M for all x. Suppose that f’(c) does exist. 
Then there is a d > O such that 


LO-LO)_ pf 
| 9-L9_ Fo) <1 
for 0 < |c—x| < 4, so that 
ef =f) < |f(O|+1 for 0<|c—x| < 6; 
LO =FO)| < 


for |c—x| > 4. 
c-x 


and 


The last two inequalities contradict the unboundedness of 
{fO-SO}(e-»). | 
Theorem 5.51. There exists a real function which is continuous on 
(—©0, 00), but nowhere differentiable. 
Proof. Let g be the function on (— 90, 00) defined by 
a(x) = |x| for |x| < 2 
g(x+4n) = g(x) (n = +1, +2,...). 
Then (i) g is continuous, (ii) 0 < g(x) < 2 for all x, (iii) for all x, y, 


s@)—8))| < 1 
x-y | 
(iv) given c, there is an x) such that 
g()—8%)| _ | 
C—Xq 
When n = 0, 1, 2, ..., define the functions g, by 
8n(x) = arg(b"x), 
where a, b are positive constants. Then (i)’ g, is continuous, (ii)’ 
0 < g,(x) < 2a” for all x, (iii)’ for all x, y, 


En) = En)! < ang, 
x-y 


Je—xo| = 1 and 
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(iv)’ given c, there is an x, such that 


8n(C)—8n(Xn) 
C—Xy 


= arb". 


|c—x,| = b-™ and 


If 0 <a < 1, Xg,(x) convetess uniformly on (— ©, 00) (by the 
M-test) and so 
eS 3 8n 


is continuous everywhere (by theorem 5.21). However we shall show 
that, if a is sufficiently small and d is sufficiently large, f is nowhere 


differentiable. 
Taking ab > 1 we have 
L()—F%n) = > &i(C)—Bi(Xn) 
C=Xn i=0 C—Xpn 
En(C) = 8n(Xn) ie ) &i(C)—8i%n) 
>) ea Sont n= SAC) = Fii%n) 
C—Xy 2 +3, C—Xn 
—1 «o i 
>arn—"S att 5 
i=0 i=n+1 
percths— ly 2beqett 
eral io 
1 2a 
> Veer) le 
: 1 2a 
Hence, if also la > 0, 


the lemma shows that f’(c) does not exist. This inequality holds if a 
is small and b large enough, for instance if a = 4, b = 20. Thus the 


function given by Eee 
Hx) = E5820") 


is everywhere continuous and nowhere differentiable. | 


The non-differentiability of f is not dependent on the lack of a 
derivative of g, at the points 2k/b”. It is possible to start with a 
differentiable function g; in fact, the first continuous, nowhere 
differentiable function, constructed by Weierstrass, was 


> a" cos b"1rx (0 < a< 1,ab > 1+3n). 
fe 
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Tietze’s extension theorem. If a real function f is continuous on 
[a, b], it is easy to define a function f* continuous on R' such that 
S*(x) = f(x) for a < x < b. Tietze proved a theorem extending the 
domain of definition of a given function continuous on a closed set 
in an arbitrary metric space. 


Lemma. Suppose that (X,p) is a metric space, g is a real valued 
function continuous and bounded on a closed set F in X and 


sup |g(x)| = M. 
zek 


Then there is a real valued continuous function h on X such that 
(i) |A@)| < 4M for x € X, and 
(ii) |g) -A@)| < 4M for xe F. 
Proof. Let A= {xeF|—M < g(x) < -4M}, 
B = {xe F|-4M < g(x) < 4M}, 
C = {xe F|4M < g(x) < M}. 
By theorem 3.23, A and C are closed and so, by exercise 3(f), 12, the 
function h on X given by 


p(x, A)—p, C) 
Wx) = 3M, Ate, c) &€*) 


is continuous. Clearly (i) holds. To establish (ii) we compare the 
values of g and / on the sets A, B, C. 

On A, -—M < g(x) < -4M and h(x) = -4M. 

On B, |g()| <4M and |A(x)| < 4™. 

On C, 4M < g(x) < M and A(x) = 4m. | 


Theorem 5.52. (Tietze’s extension theorem.) Let (X, p) be a metric 
space and let f be a real valued function continuous and bounded on a 
closed set F in X. Then there is a real valued continuous function f* 
on X such that 

(i) f*(@) = SQ) for x € F, and 

(ii) the bounds of f* on X are the same as the bounds of f on F. 


Proof. Since we can add a constant function to f, we may suppose 
that the range of fis symmetrical about 0; say 


inf f(x) = —K, sup/(x) = K. 
cer wer 
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Define the sequence (f,,) of real valued, continuous functions on X 
as follows. Let f, be the function A of the lemma corresponding to 
g =f. When f, ...,fn-1 have been defined, let f,, be the function h 
of the lemma corresponding to g = f—(f,+-..t+/n-1). Induction 
shows that, for all 7, 


IAC) < 4@)"7K (xe X), (5.51) 
|f) -[Th@) +... +fC)]] < OK (we F). (5.52) 
By (5.51) and the M-test, Xf, converges uniformly on X to a 


function f*. Theorem 5.21 shows that f* is continuous on X and 
(5.52) shows that f*(x) = f(x) for x ¢ F. Again, by (5.51), 


If@)| < 4K 3 @ = K 
for all x e¢ X¥. Hence 


K = sup f*(x) < supf*(x) < K 
wer weX 


and so sup f*(x) = K. Similarly inf f*(x) = —K. | 
weX eX 


Corollary. (Urysohn’s lemma.) Let (X, p) be a metric space and let 
A, B be disjoint, closed subsets of X. Then there is a continuous function 
f: X > R® such that 0 < f(x) < 1 on X, f(x) = 0 for xe A and 
F(x) = 1 for xe B. 

This result shows that, given an arbitrary metric space, there is a 
plentiful supply of real valued functions continuous on it. 


Exercises 5(e) 


1. Construct a function on an interval [a,b] which is everywhere x times different- 
iable, but nowhere has an (n+ 1)th derivative. 


2. Let (r,) be a sequence consisting of all the rational numbers in (0, 1) and 
define the function / on [0, 1] by 
i —_ 
fey = & Fel @ex<n. 
n=l 2 
Show that fis continuous on [0, 1] and not differentiable at the points r,. 
[Define up, (n = 1, 2, ...) on [0, 1] by 
-1 for0<x<tm, 
1 i007, stom 2 


Un(x) = { 


and consider { ( ug(s)n) dx.) 
o\T 
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3. Give an example to show that the conclusion of theorem 5,52 need not hold 
if the condition that the domain F of f is closed is omitted. 


4, Let F be a compact subset of R*. Prove that, if fis a real valued, continuous 
function on F, then there is a continuous extension f* of f which is zero outside 
a sufficiently large open ball B(O; R) and is such that 


sup |f*(x)| = sup |f()|- 
zeRt zek 
5. Prove the following extension theorem. Let (X, p), (Y, 7) be metric spaces 


and let E be a subset of X. If (Y,o) is complete, then every uniformly con- 
tinuous function f: E> Y has a unique, uniformly continuous extension to E. 


5.6. Weierstrass’s approximation theorem and its generalization 


An important problem of analysis is the approximation of func- 
tions by simpler functions. Weierstrass’s theorem deals with the 
approximation of continuous real functions by polynomials. 


Lemma 1. There is a sequence of polynomials converging uniformly to 
|x| for -l <x< 1. 


Proof. If u = 1—3?, then |x| = ./(1—u) and the interval 0 <u <1 
corresponds to the interval —1 < x <1. By exercise 5(d), 8, the 


binomial series = /f 
3 ()(-u 
converges uniformly to ./(1—wu) for 0 < u < 1. Hence the series 


% (2) @r-p» 


n=0 


n. 


converges uniformly to |x| for —-1 < x < 1. | 


Corollary. Let the function g be given by 

{ 0 forx <0, 
ays lx for x > 0. 

Then, for any interval [a, ], there is a sequence of polynomials con- 
verging uniformly to g(x) fora < x < f. 


Proof. Let k be such that [a, 8] < [—k, k]. Since 
eee 
g(x) = tk (j+{f). 


the result immediately follows from the lemma. | 
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Theorem 5.61. (Weierstrass’s approximation theorem.) If the real 
function f is continuous on the finite closed interval [a, b], there is a 
sequence of polynomials converging uniformly to f on [a, b. 


Proof. It is sufficient to prove that, given ¢ > 0, there is a poly- 
nomial p such that 


|fC)-—p(x)| < ¢ for a<x<b. 
There is (see exercise 3(f), 9) a piecewise linear function h such 
- |fx)-h(x)| < de for a<x<b. 
Let the vertices of the graph of h be (Xp, Vo), (X1s ads «+> ns Yn) 
where x) = a and x, = b. Then, fora < x < b, 


n-1 
A(x) = Yo+ 2» c:g(x—%i), 


where the c’s are defined by the equations 
Vi = Yor Co(X1—Xo)s 


Va = Yo Co(X2— Xo) + Cx(%2—%1), 


Yn = Yor Co(Xn— Xo) +61 Xn— Ha) + ++ + nan — Xn) 
By the corollary, there is a polynomial p such that 


|h(x)—p(x)| < te for a<x<b 
and this gives 
|f()-pQ)| <¢ for a<x<b.| 


This proof, due to Lebesgue, is one of the simplest of the many 
proofs of Weierstrass’s theorem. Some of these are easily adapted 
to show that the result holds in R* (k > 1). M. H. Stone has put the 
theorem in a more general algebraic setting which exposes the 
essential features of the original Weierstrass theorem. To complete 
this chapter we shall prove Stone’s theorem (5.62), but neither the 
theorem, nor the algebraic setting will be appealed to in the rest of 
the book. 

Let (X, 7) be a metric space and, as usual, let C(X) be the space 
of real valued functions bounded and continuous on X. Algebraic 
operations in C(X) are defined in the obvious way. If f, g ¢ C(X) 
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and @ is a real number, the (bounded and continuous) functions 
t+, fg and of are such that, for all xe X 
(f+8)@) =f@) +8), 
()@) = f@)8Q), 
(of)(x) = af(x). 
Definition. The subset A of C(X) is called an algebra if, whenever 
f,g€A and « is any real number, f+g, fe, af € A. 

The set of polynomials and the set of differentiable functions on 
[a, b] are clearly algebras in C[a, b]. 

Using the usual metric p on C(X) we now consider the closure A 
of an algebra A. A is, in fact, the set of those functions in C(X) 
which are the limits of uniformly convergent sequences of members 
of A. 


Lemma 2. If (X, 1) is any metric space and A is an algebra in C(X), 
then A is also an algebra. 


Proof. Let f, g € A. Then there are sequences (f,), (g,) of members 
of A which converge uniformly on X to f, g respectively. 

Clearly f,+8n >/+g uniformly on X and, if a is any real number, 
af,, > af uniformly on X. Also, since all functions in C(X) are 
bounded, every uniformly convergent sequence is uniformly bounded. 


Therefc 

ere SuBn-I8 = Sul Bn—8)+8Sn—f) + 0 
uniformly on _X. Thus, since fr +n, “ns In&n © A, it follows that 
S+8, of, fg eA. | 


Weierstrass’s approximation theorem asserts that the algebra 4, 
of polynomials on [a, b] is dense in C[a, b], ic. that 4, = C[a, b]. 
We shall see that, more generally, the relation A = C(X) holds if 
(X, 7) is compact and if the algebra A satisfies the following two 
conditions: 

(i) A contains some non-zero constant function and so all constant 
functions, 

(ii) A separates points on X, i.e. to every pair x, Xx, of distinct 
points of X there corresponds a function f € A such that f(x,) + f(x2). 

The algebra of polynomials on [a, 5] satisfies both (i) and (ii); 
the algebra of even polynomials on [—1, 1] satisfies (i), but not (ii); 
and the algebra of polynomials on [0, 1] with zero constant term 
satisfies (ii), but not (i). 
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Theorem 5.62. (The Stone-Weierstrass theorem.) Let (X,7) be a 
compact metric space. If A is an algebra in C(X) which | contains the 
constant functions and which separates points on X, then A = C(X). 


ne first show that, if fe A, then |f| ¢ A (where |f| is defined by 
|F|@) = |£@)|). Let sup |f(@)| = and take any ¢ > 0, By the 
corollary to lemma 1, there is a polynomial p given by 
P(E) = Moto t+... +a n5” 
such that \|El-—p(®| <¢ for -w< <p. 
As A is an algebra containing the constant functions, 


Poof = Mt ft. tay f” 
belongs to 4. Also 


LfC)|-(@ OE)! = [1fC)|-PL/}| < € 
for every x € X. Since A is closed in C(X) (by theorem 2.36), it follows 
that |f| € 4. 
Il. Defining min (f, g) and max (f, g) by 
(min (f, g))(x) = min (f(), g), 
(max (f, g)) (x) = max (f(x), (x) 


min (f, 2) = 1(f+g-|f-g]), 
max (f, g) = 1(f+g+|f-g\). 
Hence, by I, if f, g € A, then min (f, g), max (fg) € A. 


Ill. Let f be any function in C(X). We need only show that 
given e > 0, there is a function g ¢ A such that 


|f@)-g@)| < € 
for all xe X. 


Let u, v be two arbitrary distinct points of X. There is a function 
@e€A such that ¢(u) + 4(v) and, since A contains the constant 
functions, we may assume that ¢(u) = 0 so that ¢(v) + 0. Also let 
yr be the constant function given by ¥(x) = f(u) for all xe X. 

If « is the real number such that 


ad(v) +f) =f), 
the function Buy = ob t+y 
is such that g,,(u) = f(w) and g,,(v) = f(v). We note that g,, € A. 


we have 
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Since g,,, and f are continuous, the set 
K, = {x|x € X3 u(x) < f(x) +4} 


is open; moreover it contains both u and v. Hence the collection 
of sets K,, where v ranges over X—{u} is an open covering of X. 
Since X is compact, by the Heine-Borel theorem there is a finite 
number of sets K,,, ..., K, covering X. Let 


= min (ise weep Seog) 
By Il, g,, € A; also g,(u) = f(u) and g,(x) < f(x) +e for all xe X, 
The set Jy = {x|x € X3 g,(x) > f(x) -3 
is open. We note that 
f@)-€ < gx) < flat for xeJy 


The collection {J,},,<x is an open covering of the compact space XY 
and so a finite number of sets J,,, ..., Jy,, covers X. Let 


& = MAX (B,,5 «++ Sum) 
Then g€ A and f(x)—¢ < g(x) < f(x) +e forall xe X. | 


Clearly the multi-dimensional form of Weierstrass’s approxima- 
tion theorem is a particular case of theorem 5.62. A trigonometric 
analogue of Weierstrass’s theorem is given in exercise 5(f), 2. 

There are also complex versions of theorems 5.61 and 5.62. For 
instance every complex function continuous on a compact subset of 
Z is the limit of a uniformly convergent sequence of polynomials in 
z and Z, That polynomials in z alone will not do is a consequence of 
another theorem of Weierstrass. (See exercise 13(a), 6.) 


Exercises 5(f) 
1. The real function fis continuous on [a, 6] and, for n = 0, 1, 2, ..., 


[ S(x)x"dx = 0. 


b 
Show that [ S*x)dx = 0 
a 


and deduce that f(x) = Ofora<x <b. 
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2. A trigonometric polynomial is a real function of the form 


n 
a+ > (a, cos rx+b, sin rx). 
r=1 
Deduce from theorem 5.62 that, if fis continuous on [«, 7], where B—a < 27, 
then f is the limit of a uniformly convergent sequence of trigonometric poly- 
nomials. Show that this result is false if 8—« > 27. Which condition of theorem 
5.62 is then violated? 


3. Prove that every real function continuous on the interval [a, 5] is the limit of a 
uniformly convergent sequence of even polynomials if and only if (a, b) does not 
include the origin. 


4. Alternative proof of Lemma 1. Show that the only solution of the equation 
y = 40°+1-2*) 


which satisfies y < 1 is y = 1— |x|. 
For —1 < x < 1, define the sequence (y,,) of functions by 


Vox) = 1, n(x) = HOR AG)+1-27} (x = 1, 2,...). 
Prove that, for —-1 < x < 1 andn=0,1,2,..., 
Ya(x) > 1— |x] and Ynya(x) < Yn(x). 
Deduce that y,(x) > 1— |x| as noo, uniformly for —1 < x < 1; and hence 


that there is a sequence of polynomials converging uniformly to |x| for 
-l<x<l. 


NOTES ON CHAPTER 5 


§5.1. The notion of uniformity of convergence was made explicit by three 
mathematicians independently, Weierstrass, Stokes and Seidel in the late 1840s. 
The idea was rediscovered a few years later by Cauchy. A critical examination of 
the exposition of the early writers was made by Hardy, ‘Sir George Stokes and 
the concept of uniform convergence’, Proc. Cambridge Phil. Soc. 19 (1918), 
148-56. Hardy’s note includes developments of Stokes’s work and answers 
questions which the reader may have asked himself on §5.2, It is noticeable in 
theorem 5.21 that the full strength of the hypothesis of uniformity is not used in 


the proof. The inequality COLERONSC 
n(X)» 
weX 


is quoted only for a single n, not for all n > N. This indicates that a condition less 
restrictive than uniformity should suffice for theorem 5.21. Such a wider condi- 
tion, due in substance to Dini and called quasi-uniform convergence, is necessary 
as well as sufficient for the continuity of the limit function of a sequence of 
continuous functions. However it lacks the simplicity possessed by the condition 
of uniformity of convergence and, instead of reproducing it here, we refer the 
interested reader to Hardy’s paper. 


§5.4. N. H. Abel (1802-29) established his continuity theorem with the 
immediate aim of investigating the validity of the binomial expansion at the 
points +1. In the original proof, partial summation (theorem 4.52, corollary) is 
used to show that on the right-hand side of the identity 


o ao N C3 
YD a- DY ax" = Y a(l-x)+ DY  a(l-x") 
n=0 n=0 n=0 n=N+1 
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the second term can be made arbitrarily small for all x in (0,1) by choice of a 
large N; the first term may then be made small by choice of x near 1. 

The relation 1—4+4-—... = 47 was first noted by J. Gregory (1638-75) and 
was later obtained independently by G. W. Leibniz (1646-1716). 


§5.5. Weierstrass’s construction of a continuous, non-differentiable function 
was published in 1861. Until then arguments based on geometrical intuition 
were still acceptable to some analysts. The fallibility of such reasoning was 
finally demonstrated by this function which so strikingly contradicts the promp- 
tings of the visual imagination. 

The proof of theorem 5.51 is based on a method developed by F. A. Behrend 
(‘Crinkly Curves and Choppy Surfaces’, Amer. Math. Monthly, 67 (1960), 
971-73). 


§5.6. Stone gave an account of ‘The generalized Weierstrass approximation 
theorem’ in Math. Magazine 21 (1948), 167-84 and 237-54. This paper is not 
readily accessible, but it has been reprinted, with only minor changes, in Studies 
in Modern Analysis (ed. R. C. Buck), 20-87. 


6 
INTEGRATION 


6.1. The Riemann-Stieltjes integral 


Suppose that f is a bounded real function on the finite interval 
[a, b]. If D is a dissection of [a, b] given by 
BD Kg S Xy Mises Nyag = %y = O, 
let inf f(x)=m, sup f(x) =™M, 
MSH USES 
Then the sums 


n 


m(Xi—Xi-1)> z M(xi-Xi-1) (6.11) 


b 
approximate to the Riemann integral f, when it exists (C1, 123-4), 


A far reaching extension of this process is due to Stieltjes who 
introduced a second real function g, assumed to be increasing on 
[a, b] (in the wide sense), and replaced the increments x;—x,-, in 
(6.11) by g(x;)—g(x;-1). This new procedure leads to an integral of f 
with respect to g. The sums corresponding to (6.11) are 


(2) = 19,f,8) = 3 mige)-s%d» 6.12) 


SQ) = SQ, Ff, 8) = . Mi{g(xi) -—8(%i-D}; (6.13) 


they reduce to (6.11) when g(x) = x (a < x < b). Denoting the 
infimum and supremum of f(x) on [a, 5] by m and M respectively we 


have 

m{g(b)—g(a@)} < (9, f, 8) < S(P,f,8) < M{g(b)—g(@)}. 
Thus, for all dissections 2, the lower sums (6.12) and the upper sums 
(6.13) are bounded. 

It is easy to see that the introduction of new points of division 
increases the lower sum and diminishes the upper sum. (See exercise 
6(a), 1.) From this it follows that any lower sum is less than or equal 
to any upper sum. For let 2, and F, be any dissections of [a, 4]. If, 
now, @ is the dissection containing all the points of division of D, 
and Q2,, then 

(D) < (BD), (B) < SD), SD) < (A) 
and so 3(Dy) < S(D,). (6.14) 
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Definition. Write 


sup (2, f,8) = [ive (or [revace), 


inf (2,8) = [ve (or [ire dex), 


where the supremum and infimum are taken over all dissections 9 of 
[a, b]. The first expression is called the lower integral of f with respect 
to g over [a, b}, the second the upper integral. 


Note that [rae and [tae exist whenever fis bounded on [a, b] and 


g increases; also, by (6.14), 


[ire < [ve 


Definition. If [v dg = fr dg, 


S is said to be integrable with respect to g over [a, b] and the common 
value of the upper and lower integrals, denoted by 


[ira (or freoaeco) 


is called the Riemann-Stieltjes (or RS) integral of f with respect to g. 
The function g is called the integrator, the function f the integrand. 
The class of functions integrable with respect to g over [a, b] is denoted 
by R (g; a, b). 

It is convenient to complete the definition of the RS integral by 


putting x b 
[irae = - [fae 


(when the right-hand side exists) and 


i foeiai0 
(for all functions f, g). : 

When g(x) = x(a < x < b), the Riemann-Stieltjes integral re- 
duces to the Riemann integral. The definition of the Riemann 
integral given in C1 (123) is not obviously the same as the one given 
here in terms of upper and lower integrals, but the equivalence of the 
two definitions will be proved in theorem 6.72. Both definitions are 
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useful. The class of functions Riemann integrable over the interval 
[a, b] will be denoted by R(a, b); and upper and lower Riemann sums 
by S(,f), (F,f). 

Mlustrations 


(i) Every constant function k has an RS integral with respect to any increasing 
function g and 


'b 
f kdg = k(g(b)-g(@)}. 


This follows from the fact that, for all 2, (7) = S(Z) = kig(b)—g(a)}. 
(ii) Let f be the function defined by 


f(x) = | 


1. if x is rational, 
0. if x is irrational. 


Then inf f(x) = 0 and sup f(x) = 1 in every interval. Hence, when g is any 
increasing function, 


b Tb 
[ fag = 0 and J _ fae = 8(0)-#(@. 


Thus, if g is not constant, f¢ R (g; a, 6). 


In the rest of this section we establish the elementary properties of 
the Riemann-Stieltjes integral. When defining it we made the assump- 
tion that the integrator is increasing and the integrand is bounded. 
We continue with this pre-supposition without always stating it 
explicity. 


Theorem 6.11, A necessary and sufficient condition that f € R (g; a, b) 
is that, given e > 0, there is a dissection D of [a, b| such that 


SD, f, 8)- (Ff, 8) < € (6.15) 
Proof. 
(i) If fe R(g; a, 5), ie. if 
b To 
[ fae = | Fae, 
then, given ¢ > 0, there are dissections , and Z, such that 
b 
sa.)-{ fdg <4e and [fe-99 < te. 
a a 


Thus S(D,) —s(D) < €. 
Now let @ be the dissection containing all the points of division of 
Q, and of Z,. Then 
S(B,) > S(D) > (B) > (B.) 
and so (6.15) holds. 
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(ii) Suppose that, for every e > 0, there is a M such that (6.15) 
holds. Then, since 


Tb yo 
S(2) > | fag > | fe > (9), 
a Ja 
To b 
it follows that . O0< [raf fdg <e. 
This holds for all ¢ > 0 and so | Sfdg = i tdg. | 
a a 


The next theorem gives the existence of the Riemann-Stieltjes 
integral in two simple but important cases. In its proof, and later, 
we call the length of the largest subinterval of a dissection Z the 
mesh of and we denote it by “(). 


Theorem 6.12. 

(i) If f is continuous on [a, b], then fe R (g; a, b). 

(ii) If f is monotonic on [a, b] and g is continuous (as well as increas- 
ing), then f € R(g; a, b). 

Proof. 

(i) For any dissection 9 of [a, b] we have, with the usual notation, 


S)—-S) = 3 (Me—m) {g(x -e%-2)} 


IN 


max (M;—m,) z {g(%:) —a(x:-)} 
l<i<n i=1 

max (M;—m,){g(b)—g(a)}. 

l<i<n 


Since f is uniformly continuous on [a, b], max (M;—m,) may be 
made arbitrarily small by taking “(Y) sufficiently small. Theorem 6.11 
then shows that fe R(g; a, b). 

(ii) Suppose that f increases. Then 


S(2)-6) = 3 feed -Fer-D} eo) -a(%i-»)} 
< max {e(x) -s@i vd} fO-f@} +0 
as (2) - 0, by the uniform continuity of g. | 


Part (ii) of the theorem will be much improved in theorem 6.24. 
We now prove that the RS integral is linear in both the integrand 
and the integrator. 


6.1] THE RIEMANN-STIELTJES INTEGRAL 143 


Theorem 6.13. 
(i) @ Iffe R(g; a, b), then kf € R(g; a, b) for every constant k and 


b b 

iE dg = i [ fae. 

(6) If fi, fz, € R(g; a, b), then fit fz € R(g; a, b) and 
'b b b 
[i cittids = [fide +f fade. 
(ii) (@) If fe R(g; a, b), then fe R (kg; a, b) for every non-negative 

constant k and ‘i + 

fates) = & fF. 


(0) If fE R (gi; a, b) and fe R(go; a, b), then 
Se R(g1 +825 a, b) 


and [taei+209 = [fer [Fae 


Proof. 
(i) (a) This follows immediately from exercise 6(a), 2. 
(6) We first note that, since 


inf f,+inf f, < inf (fits), 
SD, fi, 8) + (DF, fa, 8) < (D,fitSy 8)» (6.16) 
Now, given ¢ > 0, there are 2,, , such that 


b 7) 
Pnfiu8) > [Adee and Pyfye) > [fde-¢ 
and, if Z has all the points of division of 2, and of 2,, 


P,fv8) > [fide and Pfu) > [fide 
Hence, by (6.16), a 


b b b 
[fide [fade < (D,firfn 8) +26 < | irsde +26. 
Since this holds for every e > 0, 
b b b 
[fide+[ fade < [Ui fdde. 
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It is proved similarly that 


[Ades friae > [itis 


These two inequalities show that, if f,, fr ¢ R(g; 4, 6), then f+. fy € 
R(g;a,b)and ., ‘ i 
[ovttode = [fae [ fae. 


(ii) The proof of (a) is very easy, that of (b) follows from exercise 
6(a), 3. | 
Theorem 6.14. 

(i) If fi, fo € R(g3 a, b), then fify € R(g; a, 6). 

(ii) If inf |f(x)| > 0 and fe R(g; a, b), then I [fe R(g; a, b). 

a<gz<b 
Proof. 
(i) There is a K such that |/,(x)|, |f(x)| < K for a<x<b. 


Then 
IAMAM -AOLO| 
= |fMAW-AOLOtAMLO-AOLO| 


< K|AM-AO|+K/AM-AOl 
and so, in any subinterval of [a, 5], 
sup fi(x)fo(x) — inf (x) A) 
< K{sup fi(x) —inf f,(x)} + K{sup f(x) -inf A)}. (6.17) 
Now, given € > 0, there is a 2 such that 
SD, fr, 8)- (PD, fg) <¢ and S(, fz, g)-(G, fy 8) < € 
and, by (6.17), 
SD, Sifes 8)- PD, fife 8) 
< K{S(Q,f,, 2) -, fr, 8)} + KSB; fas 8) -— (F, fa» 8} < 2Ke. 
(ii) If aint, Ifo = k (> 0), we have 


fO)-f)| . \L=/)| 
SMSO) |~ BO 


a 
Sw) fe) 


Hence 
SP, If, g)—(, lf, 8) < (Uk){SGF, 8)- (FS, )} 
and the right-hand side may be made arbitrarily small. | 
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Theorem 6.15. If f  R (g; a, b), then|f| € R (g; a, b) and 


[fi t4e| < fPirlae. 


Proof. Since || f(u)|—|F@)|| < FHF), 
SQ, |f|, 8)-(F, |f|,8) < SG,F, 8)-99,F, 8) 


and so | f| € R(g; a, 5). 
Also, since —|f| < f < |f|, it follows from exercise 6(a), 5 and 
theorem 6.13, (i) (a) that 


b b b 
= [islde < [fae < fsa. | 
b 
It is easy to give an example showing that [ |f|dg may exist 
a 


without Sdg existing. (See exercise 6(a), 6.) 
Lemma. Ifa <b < c, 

@ | sae [sae = |Fas, 

Gip {fde+[ fae = {"fae. 


Proof. We prove (i); the proof of (ii) is similar. 
Given e > 0, there are dissections 2,, D,, Z of [a, b}, [b, cl, [a, c] 
respectively such that 


To Te Te 
s(@:)-| fas a 5(9.)~ | "fae <6; s(2)- [fag Be 


Let 2’ be the dissection of [a, c] containing all the points of division 
of 2, Z, and Q,. In particular, 9’ has b as a point of division. Now 
let Dj, Dy be the dissections of [a, 5], [b, c] respectively induced by 


Thea S()) + S(B}) = S(2') (6.18) 
and 


To Fe 
ipes ) ‘fdg—S(B') <0, -e< | ‘fde-S()) < 0, 
a b 


0< sa f fae <6 
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Adding these inequalities and using (6.18) we have 


To Te Te 
=e | fig + |" fag | panera 
a b a 
Since this holds for all ¢ > 0, (i) follows. | 


Theorem 6.16. 
(i) Iffe R(g; a, b) and fe R(g; b, c), then fe R (g; a, c) and 
ce b ec 
[tae = [ste ["Fas. 
(ii) If fe R(g; a, b) and if [c, d] is any subinterval of [a, b], then 
SER (g; c,d). 
Proof. 
(i) By the lemma, 
c b C Te 
[tae = [sae [sas = |" Fae. 
(ii) Again, by the lemma, 
c d b b Te Ta To 
[irae ["rae+[ "sae = [fae = |’ fae |" fe | fae 


and so 


(ef) [rf (ter) 0 


Since each of the three terms on the left is non-negative, each term 
is 0. | 


Notes. 

(1) By (i), fe R(g; a, 5) if f is piecewise monotonic, i.e. if [a, 5] 
may be divided into a finite number of subintervals in each of which 
Jf is monotonic. 

8 

(2) In view of the definition of Sdg when « > f, we need not 
assume in (i) thata < b < c, 

Theorem 6.17. (Change of variable.) Let fe R(g; a,b). If ¢ is a 


continuous, strictly increasing function on the interval [a, £| such that 
(a) = aand $(f) = b, then fo ¢ € R(go $; a, ) and 


[irae = [ro #dtgo9). 
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Proof. The relation x = ¢(t) (x €[a, b], te[«, A]) sets up a bi- 
jection between the dissections 9 of [a, b] and the dissections 2* of 
[z, A]. Also, if 2, Z* correspond, 


(QD, f, 8) = (D*, fo $,g0%), S(P,f,8) = S(D*,fo ¢g, go 9) 
and therefore 
b A To Te 
[irae = [' ve paeos, "sae = ["v0 satgo 9. | 
Other simple properties of the Riemann-Stieltjes integral are 


given in exercises 8-10 below. 


Exercises 6(a) 
1. Show that, if 2’ is a dissection of [a, 5] which contains all the points of division 
of the dissection J, then 


SD,f,8) < SQL), (Df, 8) > (D,f, g)- 


2. Prove that, when k is a constant, 
To To b b 
J, ae = Kf" fae, [onde = Kf" sae te > 0 
” 4M iobs Ne 


if ide = Xf see, [ de = Kf fae «<0. 
3. Prove that 
P racert00 =| sae | fae i *filevted = [fies i) * flee 


4. Let fe R(g1; 4, POR Gees b). Show that, if g,—g, is increasing, then 
SE R (81-823 a, 6) and 


[i face.-e0 = fe fide, f fi 
5. Show that, if f(x) < f(x) for a < x < 5, then 
f. fae <[? fae, f "fide < [he 


6. Construct a function f such that, for any non-constant g, |/| € R(g; a, 5), 
but f¢ R(g; a, b) 


7. Find functions f, A, g (where g is increasing) such that 


[ueme flee] au [ornare 
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8. Suppose that f, he R(g; a, b) and h(x) > 0 for a < x < b. Show that there 
is a number A between the infimum and the supremum of f on [a, 5] such that 


b b 
[mae = af hdg. 
a a 


(This result with h(x) = 1 is the first mean value theorem.) 
9. Show that, if fis continuous on [a, b] (and g is increasing), then 


2) 
S, 5,0, 8, f.8)-> | Fe 
as (PD) +0. 
10. Let fe R(g; a, 6) and define the function F on [a, b] by 


F(x) = [ire (a<x<b). 
a 


Prove that 
(i) F is continuous at every point of continuity of g; 
(ii) F is differentiable at a point where fis continuous and g is differentiable 


and, at such a point x, Fe) = fen. 
11. Let g be increasing on [a, b]. Show that, if f is bounded on [a, 6] and 
ie. fdg exists whenever 0 < h < b—a, then i dg exists. 


12. A function ¢ defined on an interval containing the point c is said to be eft 
continuous at c if d(c—) = (0), i.e. 
lim (x) = ¢(c). 
ze 
Right continuity is similarly defined. 
Let f be bounded and g increasing on [a, 5]. Prove that, if f and g have a 
common left discontinuity or a common right discontinuity, then f/¢ R(g; a, 5). 


13. Suppose that, for n = 1, 2, ...,f,€R(g; a, b) and that f, > f uniformly on 
[a, 5]. Prove that fe R(g; a, b) and 


[hae ~ f fg 


14. Show that, if f is non-negative and continuous on [a, 5] and g is strictly 
increasing, then 


asn->o, 


(fisras) "> sup, s00 


asn-> oo, 


6.2. Further properties of the Riemann-Stieltjes integral 


The material in this section is rather more sophisticated than-ttfat 
of §6.1. Familiarity with it is not necessary for a reader who is 
primarily interested in the Riemann integral. We begin by showing 
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that, if the integrator has a Riemann integrable derivative, or is an 
indefinite Riemann integral, then the RS integral reduces to an 
ordinary Riemann integral. 


Theorem 6.21A. Let fe R(a,b). If the increasing function g is 
differentiable in [a, b] and g’ € R (a, b), then fe R(g; a, b) and 


fireodea = [re9e'@)ae. 


Proof. If the theorem has been proved for non-negative f and so, 
in particular, for a non-negative constant, it holds for any f € R (a, b). 
For we can then write f = (f+ C)-—C, where C is such that 


f(x)+C>0 


for a < x < b. We may therefore suppose that f is non-negative in 
[a, b]. Since g’ is also non-negative, in any subinterval of [a, 5], 


inf f(x) inf g(x) < inf.f(x)g’(x) < inf f(x) sup g’(x). (6.21) 


As g’, fg’ © R(a, b), a now familiar argument shows that, given 
é > 0, there is a dissection 9 of [a, 4] such that the inequalities 


SF, g')-(F, 8') < «, (6.22) 

SP, fe')—(F, fe’) < € (6.23) 
both hold. If Z is given by 

Omi Sy << Mi Kym d, 
denote the infima of f(x), g(x), f(x)g'(x) in [xa xi) by my mis Pi 
and the supremum of g’(x) by Mj. By (6.21), there is a number 4, 
such that mi, < ; < Mj and 
Re= My. 
Also, by the mean value theorem, there is a number yj such that 
m; < “i; < Mj and 
8%) 8%) = Hi — 4-2) (6.24) 

Then, by (6.23), 


b n n 
[ime < 3 plea) = 3 mau +00) Om) 


=~ = m{g(x) —g(%i-)} + > mM; — Hi) (%— X;-1)- 
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But, if M = sup f(x), 

agr<gb 
then, by (6.22), 


E mieux] < ME Mi mipoxi—m3) < Me 
and so [ir < (2, f, g)+(M+l)e < (” fe + (M+ le. 


This holds for all ¢ > 0 and therefore 


Pe [ie 


It is shown similarly that 


b Te 
f fe’ > { taal 
a a 
Theorem 6.21B. Let f, g © R (a, b) and let G be an indefinite integral 


of g, i.e. - 
G(x) -f g(t)dt+K (a<x <b), 


where K is a constant. If g is non-negative on [a, ] (so that G increases), 
then f € R(G; a, b) and 


b b 
[i readaws = [ reagcaae. 


Proof. The previous proof with g’ replaced by g, and g replaced by 
G applies almost word for word. The only difference is that the 
analogue of (6.24), which reads 


G(x,)— Gi) = Hi — Xi), 


is obtained by remarking that G(x;) — G(x;_,) lies between m/(x;— x;_1) 
and M((x;—x;-1). (Alternatively, see exercise 6(a), 8.) | 


It will be seen later (in theorem 6.84) that, if g’ is R-integrable, 
then g is an indefinite integral of g’. Thus, theorem B in fact includes 
theorem A. 


Having disposed of smooth integrators we pass to the consideration 
of discontinuous ones. 

The real function ¢ on the interval [a, b] is said to have a jump 
discontinuity at the point x in (a, b) if d(x—) and ¢(x+) exist, but 
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are not both equal to ¢(x); the definition is appropriately modified 
for x = aorx = b. Also, as in exercise 6(a), 12, we call ¢ continuous 
on the left [right] at x if d(x—) = ¢(x) [A(x+) = A(x]. Since an 
integrator g on [a, 5] is increasing, any discontinuities of g must be 
of the jump variety. The simplest discontinuous integrator is a 
function which is constant except fora jump at a single point. If the 
jump is not at an end point, then the function is of the form 


«a fora<x<u, 
g(x) = 


B foru<x<b, 
with a < f and a < g(u) < f#. Otherwise the form is 
« forx=a « fora<x<bB, 


s@) = { B forx = b. 


or a =| 


Bb fora<x<b 


Theorem 6.22. Let g on [a,b] be constant except for a jump at the 
point u. Then f € R(g; a, b) if and only if f is continuous on the left 
when g is discontinuous on the left and continuous on the right when g 
is discontinuous on the right. If f € R(g; a, 6), then 


| (F@fea+)-8@} w= 4), 
fife = {704-80} @ <<, 
fO)(e®)-s-)} w=. 


Proof. When f, g have a common discontinuity on the left or on 
the right, then, by exercise 6(a), 12, f¢ R(g; a, 5). 

Suppose now that there is no such common discontinuity. 

First let a < u < b. We shall show that fe R (g; a, u) and that 


[sae = 1000) 2) 6.25) 
This clearly holds when g(u) = g(u—), i.e. when g is constant on 


[a, u]. When g(u) > g(u—), take ¢ such that a < ¢ < wand let D be 
the dissection of [a, u] with a, t, u as the sole points of division. Then 


aot Sx) {g@) —g(O} = (P) < [irae < [rae 
<r<u da a 
< SP) = SUP _SO){s@) —8}. 


Since f is now continuous on the left at uw, the first and last of these 
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expressions tend to f(u){g(u) —g(u—)} as t >u—. Thus fe R(g; a, u) 
and (6.25) holds. 

When a < u < 5, we prove similarly that fe R (g; u, 5) and 


[isa = fu) {g(u+)—gw)}. | 


Lemma 1. Any increasing function is the sum of a continuous increasing 
function and of countably many functions each of which is increasing 
and is continuous except for a single jump. 


Proof. Let g be an increasing function on [a, 5]. By exercise 1(c), 
10, the set of discontinuities of g is countable. Denote the points of 
discontinuity by u,, where k ranges over a countable set A which 
may be finite, possibly empty. If a < u < b, define the function g, 


by 0 fora < X < tly 
&i(X) = 8(uxz) — g(uj,—) for X = Up, (6.26) 
&(uy+)—s(u,—) foru,<x <b. 
To define g;, when u;, = a take g(a—) = g(a) and omit the first line 
of (6.26); when u;, = b, omit the last line. When A is infinite, Dg, 


converges uniformly on [a, 6], for Xg,(b) converges (the partial sums 
being bounded by g(b)—g(a)) and 


0 < g(x) < 3b) @<x<b). 
Hence, whether A is finite or infinite, the function 


I= 2 gis 
kea 


(taken to be identically 0 when A is empty) is continuous except at 
the points u; (k € A). Thus paleo 


is continuous at all points x + 1, (k eA). But, by the definition of 
8k» &—Kx is continuous at u,. Since g; (i¢ A, i + k) is also continuous 
at u;, it follows that g* is continuous on [a, 5]. 

The function g* is increasing. To prove this we first note that the 
intervals Jj, = [g(Uux—), o(uj)], Jp = [e(u,), g(u,+)] are non-over- 
lapping. Now leta < a < # < b. Then the sum of the lengths of any 
finite number of /,, J, contained in the interval [g(«), g(f)] is less 
than or equal to g()—g(a). The same is therefore true of all the 
Tx, Ji, in [8(@), g(A)]. Thus © [8iB)-8@)} < g(6)—g@), i. 


B*(a) < g*(A). | 
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Given the increasing function g, the functions g* and j defined in 
the proof of the lemma are called, respectively, the continuous 
component and the jump component of g. To obtain the decomposition 
of J fdg corresponding to this resolution of g we need another 
lemma. 


Lemma 2. Suppose that the functions g,, o, ... on [a, b] are increasing 
and that z g,, converges to a function h on [a, b]. Then h increases on 
[a, 5) et Tf € R(g;,; a, b) for every k, then f € R(h; a, b) and 
[isan = 5 [se (6.27) 
Proof. lf a < « < B < b, g(2)—g,(%) > O for every k and so 


WB)—M2) = 3 {eA)—sx@)} > 0. 


Thus / increases on [a, b]. 
Now suppose that f¢ R(g,; a, b) for every k. Let 


K = sup |f(x)|- 
a<a<b 


b 
execs | faee < Kigu(b)—ex(a)}, 
o b 
it follows that = J Sdgy, 
k=1Ja 
converges. 


Given ¢ > 0, there is a p, such that, for p > Po, 


E {ex(b)-ga)} < ¢. 
k=p+1 


Since, for every dissection 9 of [a, b], 
(PS, 8x)|, |S PS, 8x)| < K{g(b)—8(@)}, 


when p > Po, 


=, Of) 


<pt1 


, | ES MG,f9)| < Ke. (6.28) 
k=p+1 
Take any p > py. Then there is a dissection * such that 


ESOS. 8)-9*. fad} <6 
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and, using (6.28), we have 


Pp 'b p 
3 J faee-K+ 6 < 3 (94,f,90)-Ke 
=P = 
> To 
< (9*,fh) < [fan < [fan < S(D*,fN) 
a a 
i b 
< Eo" fsd+Ke < 3 [fd +(K+ De. 
= =lJa 
Thus, for any p > Po, 
p rd b To p fo 
3 [ Faee-(K+ De < [fan < {fan < 3 [facet (K+ Ns 
k=1Ja ga a k=lJa 
and so 
o fb 6 To o fb 
ei ‘fde,—(K-+1)e </ fa < | fah < eT) fg, +(K+ le. 
=1Ja Ja a =1Ja 
Since this is true for every ¢ > 0, fe R(g; a, b) and (6.27) holds. | 
Theorem 6.23. Suppose that g is an increasing function on [a, b] with 
discontinuities at the points u,(k € A). Let g = g*+j, where g* is the 
continuous component and j is the jump component of g. If, now, 
fe R(g; 4, b), then fe R (g*; a, b) and 
b 'b 
[fae = [saet + & feud (olue+)- eu) 


with the convention that g(a—) = g(a), g(b+) = g(b). 

Proof. Let the g, (k € A) be the functions defined by (6.26) so that 
j = Xg,. Since fe R (g; a, b), f and g can have no common left or 
common right discontinuities. Hence, by theorem 6.22, for each 
keA, fe R(g,; a, 6) and 

b 
[i Faee = Su) {giUn +) — 8c —J} = Sun) {gu +) — 8 -)}- 

It now follows from lemma 2 that fe R(j; a, b) and 


[fa = 3 feud tou) a0). 


Since g* = g—/is increasing, by exercise 6(a), 4, fe R (g*; a, b) and 


[ite = ffaers fire 
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It is the last theorem that makes the Riemann-Stieltjes integral 
particularly valuable in applications of analysis. It shows, for 
instance, that in mathematical physics this integral can cope with 
point masses as well as continuous mass distributions. 

We can now also improve theorem 6.12(ii). 


Theorem 6.24. If f is monotonic and g is increasing on [a,b] and 
if f,g have no common left or common right discontinuities, then 
fe R(g; 4, b). 


Proof. Let g = g*+j, where j = Zg,. In view of the restriction on 
the discontinuities of f and g, theorem 6.22 shows that fe R (g;,; a, 5) 
for all k. Therefore, by lemma 2, fe R(j; a, b). Also, by theorem 
6.12(ii), fe R (g*; a, b). | 


If, in theorem 6.24, f (as well as g) is taken to be increasing, then 
Se R(g;a,b) and ge R(f;a, b). The symmetry of the situation is 
further exhibited by the formula for integration by parts. 


Theorem 6.25. (Integration by parts.) If the functions f and g are 
increasing on [a,b] and have no common left and no common right 
discontinuities, then 


[-ta+[' ea - 10)20)-Sos@. 


Proof. Since f and g are increasing functions, we have, for any 
dissection 2 given by a = Xo < Xy <...< Xn < X, = 4, 


SO,f, 8) +, 8, f) 
= 3 Aed{es)-sed}+ E ee DVO) Sed) 


= f(b)g(b) -—f@g(a). (6.29) 
But, given e > 0, may be chosen so that 


S(O,f,8)-6 < [fae < S(@,f.2, 


19, 8,f) < [edf <2, 8,f+6. 


Adding these two inequalities and using (6.29) we have, for all 
e>0, 


fib)s(b)—Laata)—e < ffde+[" gal < f)e(b)-flaeta) +e. | 
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Exercises 6(4) 
1. Show that, if fis continuous on [0, ©), then for x > 0, 


= fon = [reoat, 
i<nse 0 


where [t] is the greatest integer less than or equal to t. (When 0 < x < 1, the 
sum on the left is taken to be 0.) 


2. The series }) u, converges absolutely. Find an increasing function g on [0, 1] 
n= 
and a function fe R(g; 0, 1) such that 
CJ ‘1 
Em = [fae 
ne=1 0 
3. Construct functions f, g, (n = 1, 2, ...) on an interval [a, 5] with the following 
properties: 
(i) For n = 1, 2, ..., g increases on [a, b] and fe R(gn; a, 6), 
(ii) gn > g on [a, 5}, but f¢ R(g; a, b). 


4, The functions g, (n = 1, 2, ...) are increasing on |a, 5] and g, > g uniformly 
on [a, 5]. Show that, if f increases on [a, b] and fe R(g,; a, 6) for every n, then 


f¢ R(g; a, b) and [rae [re 


6.3. Improper Riemann-Stieltjes integrals 
Improper Riemann integrals were defined in C1 (138). The 
definitions for Riemann-Stieltjes integrals are entirely analogous. 


Definition. Let g be an increasing function on [a, ©). If fe R(g; a, X) 
x 
for every X > aand lim | fdg exists, then this limit is called an 
Xo 


a 


improper Riemann-Stieltjes integral of the first kind and is denoted by 


[i 


Improper integrals have properties like those of infinite series and 
the following theorems illustrate this. The proofs are left to the 
reader. 


Theorem 6.31. (General principle of convergence.) If fe R(g; a, X) 
for every X > a, a necessary and sufficient condition for i tdg to 
a 


exist is that, given € > 0, there is an X, > a such that 


Xs 
Ife fas| <e whenever X, > X,> Xo. 
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For non-negative integrands the first comparison principle is the 
mainstay of proofs of convergence or divergence of integrals. 


Theorem 6.32. Suppose that f, $, w € R(g; a, X) for every X > a. 
(i) If $(x) = f(x) 2 0 for x > a and iN dg exists, then i: Sdg 
exists. . ‘ 
(ii) If f(x) = W(x) 2 0 for x > a and te yrdg does not exist, then 
fe Sdg does not exist. 
“When S is of variable sign (and fe R(g; a, X) for every X > a), 


0 
the simplest criterion for the convergence of | Jdg is the convergence 
a 


of i | f| dg’ (see exercise 6(c), 2). This result motivates the definition 
of absolute convergerice. 
If fe R(g;a, X) for every X >a and | |f|dg exists, then 
:: fadg is said to converge absolutely. If ) i Sdg exists, but ie \f\dg 
a a a 
does not, then i fadg is said to be non-absolutely (or conditionally) 
convergent. 


Mlustrations. These refer to the simplest and most important case, that of the 
ordinary Riemann integral. 


Ea 
@ j = dx converges absolutely, since 


ci | 
and f ae exists. 
1 
‘© sin x 
(ii) i} = dx converges non-absolutely. 
1 


‘ ‘X sin x cosx]* [(Xcosx 
First —dx= [-==] -{ zy ax. 
1 * 1 1 * 


As X + ©, the first term on the right tends to cos 1. The second term also con- 
eee 

verges, since |cos x|/x* < 1/x*. Hence i = dx exists. 
1 


sin x 


0 
To prove that f dx diverges, note that 
1 


(n+1)7 |sin x| 1 (n+1)m 4 
i a dx> arp t. |sin x| dx = Gin 
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The other two kinds of integrals with infinite range need not detain 


us. The definition of ie Jdg is obvious. a Sdg is defined as 


a co 
[i fae [aes 
the sum of these two integrals is clearly independent of a. 


The second kind of improper integral is treated in exactly the same 
way as the first kind and we do little more than give the definitions. 


Definition. Let g be an increasing function on (a, 6). If 

SER (g; ath, b) 
whenever 0 < h < b—a (so that f is bounded on every interval 
[a+h, b]) and if fae ie J dg exists, then this limit is called an improper 
Riemann-Stieltjes integral of the second kind and we denote it by 


f JSdg, or simply J Sdg. 
a+ a 


Notes. 
(1) If f is bounded on [a,b] and fe R(g;a+h,b) whenever 
0<h< b—a, then fe R(g; a,b). (See exercise 6(a), 11.) Hence 
o) 


the definition of J Sdg is likely to be invoked only when / is 
a+ 
unbounded near a. s 
(2) Suppose that fe R(g; a,b). Then f Sdg exists, but the 
a+ 


improper integral need not be equal to the ordinary integral. (See 
exercise 6(c), 6.) The two integrals do coincide when g is continuous 
at a and so, in particular, in the case of the Riemann integral. (See 
exercise 6(a), 10(i).) 


- 
The definition of f Sdg (or simply { dg) is analogous 
a a 
b 
to that of i) Jdg. Also, if a= uy < uy <...< thy <u, =b 
a+ 


and; fori = 1, «..;:7% i Sdg exists as one of the improper integrals 
War 
just defined, we call (unambiguously) the sum of these integrals 
the improper integral { Sdg. 
a 


6.3] IMPROPER RIEMANN-STIELTJES INTEGRALS 159 


The two kinds of improper integral may occur together. For we 
0 be > 4 

may define { fdg as lim i Sdg when | fdg exists either as an 
a: X-w Ja a 

ordinary RS integral or as an improper integral of the second kind. 


Series of improper integrals. We’are once again concerned with the 
reversal of two limiting processes. 


Theorem 6.33. Suppose that g is an increasing function on [a, ©), 
that the functions f,,(n = 1, 2; ...) are all non-negative on [a, ©) and 


~ (fae) Fae on 


exist and are equal for every X > a, where the integrals are ordinary 
or improper. If, now, one of the expressions 


A((fea). [Ede om 


exists, then so does the other and the two are equal. 


Proof. Suppose that the first expression in (6.32) exists. Since the 
version of theorem 4.73 with one continuous and one integral 


N fx 
variable is applicable to JSndg, and since the two expressions in 
n=l1Ja 


(6.31) are equal, we obtain the following chain of equalities in which 
the existence of any term implies that of the next. 


J (fisvae) = 3, (sim [Toate = tim 5 (oe) 


= lim ce x = g= ie (3 fa) a. | 


Xo 


In most applications of theorem 6.33 the interchangeability of 
summation and integration in (6.31) is ensured by the uniform con- 
vergence of L/,,. 

It is evident that theorem 6.33 may be restated in terms of improper 
integrals of the second kind. 


Uniform convergence. The notion of uniform convergence may be 
applied to improper integrals of both kinds. It is sufficient to con- 
sider the first kind. 
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Definition. Suppose that the function g on (a, «) increases, that E is 
a set (not necessarily equipped with a metric), and that f is a real- 
valued function on [a, 0) x E. If 


[405 nase (6.33) 
exists for every y € E and if 
sup [ere Yidets) >0 as X>0, 
veE |\JX 


then the integral (6.33) is said to converge uniformly on E. 

The theorems of §5,3 may be recast so as to apply to improper 
integrals. The analogues of the most important of these (5.31 and 
5.32) are easily obtained; the rest have to await further develop- 
ments. (See §6.9 and exercise 8(g), 1.) 

Theorem 6.34. (General principle of uniform convergence.) Suppose 


b 
that | F(x, y)dg(x) exists whenever b > a and y€ E. A necessary and 
a 


sufficient condition for (a I(x, y)dg(x) to converge uniformly for y€ E 
a 
is that, given e > 0, there is an X such that 


Xe 
sup i} Pex, dat) <e whenever X,>X,>X. 
vel |JX, 


Proof. The necessity of the condition is obvious. To prove the 


sufficiency we first note that, by theorem 6.31, fs S(x, y)dg(x) exists 


for every ye E. 
Now consider a particular y € E. Since 


Xy 
If fle yd <e whenever X, > Xi> X 
x 
and since ip F(x, y)dg(x) exists, it follows that 
xX, 


|, fo dete] < 0 


But this holds for every y ¢ E and therefore 


ft ieee det) <e for %,>X.] 


su 
ue 
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'b 

Theorem 6.35. (Weierstrass’s M-test.) Suppose that i) T(x, y)dg(x) 
a 

exists whenever b > a and y€ E. If there is a function M on [a, ©) 


such that \f(x,y)| < M(x) for a<x<w,yeEk 


and M(x)dg(x) converges, then is S (x, y)dg(x) converges (absolutely 


and) uniformly on E. 
The proof follows almost immediately from theorems 6.31 and 


6.34, 
Illustration. If c is any positive number, 
co 
[ e- sin xdx 
0 


converges uniformly for y > c. To prove this we can use the M-test, for, when 
Bam land) y= 6, le sin x| < e-*. 
Theorem 6.33 shows that the convergence is not uniform for y > 0, since, if m 
is an integer, 
(n+1)7 
i e-™ sin xdx 


na 


sup 


> sup (e+) 7) = 2, 
y>0 y>0 


In §8.7 we shall discuss functions ¢ defined, by means of uniformly 
convergent integrals, in the form 


#0) = [fl vd. 


Exercises 6(c) 
1, Prove theorem 6.31. 


0 0 
2. Show that, if fe R(g; a, X)forevery X >a and |f|dg exists, then [ fdg 
la la 


exists. 


air 
3. Show that i eee de 
2 logx 
exists, 
4 
4. Prove that t dx 
1 x+sinx 


converges non-absolutely. 


5. Prove that, for any constant a, 


(n+1)% = nt 


ne >atl 


162 INTEGRATION [6.3 


as n> 0, Deduce that, if fis any positive decreasing function on [1, 00), then 
© co 
x n*f(m) and J x*f(x)dx 
n=1 1 


both converge or both diverge. (The case « = 0 is the Maclaurin-Cauchy 
integral theorem proved in C1, 141.) 


2) 
6. Let fe R(g;a,b). Show that lim i; Sdg exists, but that, if gis discontinuous 
n—0+ Jath 


at a and f(a) + 0, then 
» » 
lim [ fdg +f Sdg. 
h-0+ Jath a 


2. log‘x. 

. Eval . 
7. Evaluate is &+)! dx. 
8. Find the values of «, # for which 

at 
dx 
f 1+x? 
exists. 
© 
9. Let c > 0. Show that Dd x"+-1 Jog (1/x) 
n=0 


converges uniformly in every interval [«,#] such that O<a</# <1. By 
applying twice the analogue of theorem 6.33 for improper integrals of the second 


kind prove that 21 fk x log (1/3) ” 
n=o(ute)® Jo 1—x st 
co 

10. Show that i et dx 
converges uniformly on any interval (0, Y], but not on (0, 00). 

co 
11, Prove that J, COS ede 

2 x+siny 
converges uniformly on (— 00, ©), 

ante 2 
12. Show that t ine dx 


(i) converges for —0 < y < 0; 
(ii) converges uniformly for |y| > ¢ > 0; 
(iii) does not converge uniformly for —0o < y < 0, 


6.4. Functions of bounded variation 

Our interest in these functions is twofold. First, they may be used 
as integrators in Riemann-Stieltjes integration. Secondly, there is a 
natural bond between them and rectifiable curves, i.e. curves of finite 


length. (See §8.1.) 
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Let f be a real function on the finite interval [a, b]. If D is the 
dissection of [a, b] given by 


GD php Sa SM iO) 
put VOf) = 3 |fed-fevh 


Definition. If V(2,f) is bounded for all dissections D of {a, b), the 
function f is said to be of bounded variation on [a, b] and 


Vif) = sup V(,f) 
a 


is called the total variation of f on [a, b]. 


Notes. 
() If f is monotonic on [a, 5], then f is of bounded variation on 
eee Vif) = |f@)-F0)|- 


(ii) If f is continuous on [a, b] and has a bounded derivative in 
(a, b), then f is of bounded variation on [a, b]. (See exercise 6(d), 1.) 
(iii) A function of bounded variation is bounded. 
(iv) (@) A function of bounded variation need not be continuous 
(since, for instance, a monotonic function need not be continuous). 
(b) A continuous function need not be of bounded variation. 
For let f be given by 


fe) = ‘i cos = (x + 0), 
0 (x = 0). 


Then fis continuous everywhere, but is not of bounded variation on 
any interval including the origin. Consider, for instance, the interval 
0, 1]. If 2, is given by the points 


pal Oe alles sigs 
» On? In= 1? In—2? In—3’ 77 3?2? 
RM Cee 1 
then) VO@nuf) = 9,453? In =2* Inna 13h! 
1 end 
= lt5t..t ats: 


Therefore V(2,,,f) > 0 asn—> and so fis not of bounded varia- 
tion on [0, 1]. 
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It is easily shown that elementary operations on functions of 
bounded variation yield functions of bounded variation. 


Theorem 6.41. If f, g are of bounded variation on [a, b], then so are 
\f|,£+8,f%. If, inaddition, inf |f(x)| > 0, then 1[f is also of bounded 
variation. ESS 


Theorem 6.42, 

(i) If f is of bounded variation on [a, c] and if a < b < c, then f is 
of bounded variation on [a, b] and on [b, c]. 

(ii) If f is of bounded variation on [a, b] and on [b, cl, then f is of 
bounded variation on [a, c] and 


Vif) = Vi(f)+ Vif). (6.41) 
Proof. 
(i) Let D,, D, be any dissections of [a, 5], [b, c] respectively and 
let Dy be the corresponding dissection of [a, c]. Then 
VP f)+V(G2f) = VBosf) < Vif) 
Therefore fis of bounded variation on [a, b] and on [}, c] and also 
Vif) + Vif) < Vif). (6.42) 


(ii) Let D be any dissection of [a, c] and let Z* be Z with b as an 
additional point of division if it is not already a point of Z. Let 2’, 
2" be the dissections of [a, 5], [b, c] induced by *. Then 


VQ,f) < VO*,f) = VB NA+VG.S) < Vf)+ Vif). 
Hence f is of bounded variation on [a, c] and also 
Vet) < ViCf)+ Vif). (6.43) 
(6.42) and (6.43) give (6.41). | 
We can now establish a simple alternative characterization of 
functions of bounded variation. 


Theorem 6.43. A function is of bounded variation if and only if it is 
the difference of two increasing functions. 


Proof. An increasing function is of bounded variation and, by 
theorem 6.41, the difference of two such functions is also of bounded 
variation. 
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Now suppose that f is of bounded variation on [a, 5}. In view of 

theorem 6.42, the variation function v, defined on [a,b] by the 

equations 

0 for x = a, 


vx) = 
A) a fora<x<b, 


exists and is increasing. Next put 


Wy = 4y—f. 
Whena<x<y<b, 


wy) — wx) = {,(y) -4)}- (f0) -f09} 
= Vuf)—{f0)-F@)} > 9. 
Therefore w, increases on [a, 5]. Also f = vy—wy. | 


Corollary. Any discontinuities of a function of bounded variation are 
jumps. Consequently the set of such discontinuities is countable. 


If u is any increasing function, then (in the notation of theorem 
6.43) v;+u and w,+u are increasing and Sf = (vy +u)—(w,y+u). So 
the representation of a function of bounded variation as the differ- 
ence of two increasing functions is not unique. 

Theorem 6.43 shows why functions of bounded variation may be 
made to serve as integrators. The next theorem is also relevant to 
Riemann-Stieltjes integration. 


Theorem 6.44. Let f be of bounded variation on [a, b]. Then vy is 
continuous on the left (right) at the point & in [a, b] if and only if f 
is continuous on the left (right) at &. 
Proof, We consider left continuity at a point £ such thata < <b. 
First suppose that v, is continuous on the left at &, ie. that 
v,(x) > v,(§) as x > §—. Since, fora < x < &, 


If)-FOd| < VECf) = vy(6)— 04>), 


it follows that f(x) > /() as x > £-. 
Now suppose that f is continuous on the left at &. If $, y are 
increasing functions such that f = ¢—y, then 


-¢€-}-YO-vE-}} =/O)-SE-) = 0, 
and so $(6)- 9(E-) = WO)-W(E-) =k 2 0. 
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Define the functions ¢,, ¥% on [a, b] by 


¢(x)+k (a<x< &), 
$i(x) = | 

$(x) (<x <b), 

W(xt+k (a<x< 4), 
WA) = { 

¥) (E<x<b). 


Then ¢,, ¥% are increasing functions on [a, b], f= ¢,-y, and 


$(E—) = $1(8), Pi(E—) = (4). Also for a < x < &, we have 
0 < v()—v,(x) = Vif) < Vid)+ VIG) 
= {0:(8) — pi} + Wal) — vi}. 


Since the right-hand side tends to 0 as x > —, v,(E—) = v,(£). 
Right continuity at a point £ (a < & < 5) is dealt with similarly. | 


Corollary. Let f be of bounded variation on [a,b]. Then the two 
increasing functions v,,w, (which are such that f = vy—Ww,) are con- 
tinuous on the left (right) wherever f is continuous on the left (right). 


If f is of bounded variation on [a, 5], define the functions p, and 
q, On [a, 5] by 


Py = Hoyt f-f@}, dy = Hos-f+F@)}, 
so that Pa) = 9a) =0 and py—q, = f—f(a). (6.44) 


It is easily seen that p, and gy are increasing functions. Also, by 
theorem 6.44, p, and g, are continuous on the left (right) wherever 
J is continuous on the left (right). The functions p, and gq, are called, 
respectively, the positive and negative variation functions of f. (Exercise 
6(d), 3 supplies the reason for this nomenclature.) These functions 
enable us to characterize all representations of a function of bounded 
variation as the difference of two increasing functions. We first show 
that p, and q, are the smallest increasing functions satisfying (6.44). 


Lemma. Let f be of bounded variation on [a, b). If r,s are increasing 
Junctions on [a, b] such that 
r(a) = s(a) =0 and r-s = f-f(a), (6.45) 


then r(x) > p,(x) and s(x) > q,(x) fora < x < b. 
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Proof. Take x such that a < x < band let D be any dissection of 
[a, x]. Then 


Vf) == |fe)-Sfed| 
= & lfr(x;)—r%-)}— fs) —s(x:-1)}| 
< Z fr(x) rid} +E {sr — si} 
= r(x) +(x). 
Since this holds for all dissections of [a, x], 
PAX) +9/X) = v(x) = Vatf) < r(x) +5). 
It now follows from the second equations in (6.44) and (6.45) that 
PAX) < r(x) and g/(x) < s(x). | 


Theorem 6.45. Let f be of bounded variation on [a, b). If u is an increas- 
ing function on {a, b] and u(a) = 0, then r = py+u and s = q,+u are 
increasing functions on [a, b] such that 


r(@) = sa) =0 and r-s = f-f(). 


Also every pair of increasing functions r,s satisfying these equations 
is of the form r = py+u, 8 = q;+u, where u increases on [a, b] and 
u(a) = 0. 


Proof. The first statement is obvious. To prove the second, take 
any points «, # such that a < « < # < band put 


p* = py—P®), 9* = %-9%), r* =r-r(@), s* = s—s(x). 


Then the restrictions of p*, q* to [a, A] are clearly the positive and 
negative variation functions of f on [«, 2] and 


r*(a) = s*(#)=0 and r*—s* = f—f(@). 
Therefore, by the lemma, p*(f) < r*(A), i.e. 
r(8)—p(B) > ra) —p(@). 
But «, f are arbitrary and so u = r—py = s—q, increases on [a, 5]. | 
Exercises 6(d) 
1. Prove Note (ii). 
2. Prove theorem 6.41. 
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3. Let f be of bounded variation on [a, 5]. For the dissection F of [a, 5] given by 
A= Xp <.X%1 < 1. < Xq-y < Xm = BD, put 


PON = 5 Silex =f +e) F000, 


O9,/) = 5 SA fxd fle-d| - Vdd 


(so that P(P,f), O(D,f) are the sums of the terms |/(x,)—/(x,-,)| for which 
S(x)—S(xi-1) 2 0 and < 0 respectively). Let 


PS) = sup P(D,f), Of) = sup O,f), 


where each supremum is taken over all dissections of [a, 5]. 
Prove that 


PUP)+ QUA) = Vif) and Pyf)- Xf) = f()-S@ 
and deduce that, fora < x < b, 
Paf) = px) and OXF) = ax). 
4. Let fe R(g; a, 6) and define the function F on [a, 5] by 
Fo) = [" fae. 
Prove that fis of bounded variation on [a, 6] and that 
b 
ran = [flak 
Show also that, iff+ = 4(|f| +), f- = 4(|f| —/), then 
b 7 
P= [rede on = [s-de. 
5. Construct functions f, (n = 1, 2, ...) on an interval [a, b] such that 
(i) (4) converges uniformly on [a, 5), 


(ii) each f, is of bounded variation on [a, 5], 
(iii) lim f, is not of bounded variation on [a, 5]. 


6.5. Integrators of bounded variation 


A function g of bounded variation can be expressed in the form 
g =r-—s, where r and s are increasing functions. It is therefore 


natural to define b b 
[fae - far [ fds 


when both the integrals on the right exist. But the expression of g 
as a difference of increasing functions is not unique and so we have 


b 
to show that our definition of I Jdg is independent of the particular 
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pair r,s. Let r;, s, be another pair of increasing functions such that 


g =r,—S, and . " 
[iférn [pass 
2 i 


both exist. Then, since r+s, = r,+8, theorem 6.13 gives 


[irae fire, = c far, + [fas 


which is what was needed. 
'b 'b 
When f is continuous, ‘ Sdr and f fds exist for every pair r, s. 
a a 


But when f has a discontinuity, then, even if f is integrable with 
respect to some pair r, s, there exist others with respect to which it 
is not integrable. For, given r and s, the increasing function u may 
be so chosen that r+u and s+u have a discontinuity at the same 
point as f. We therefore call f integrable with respect to g if there is 


b b 
some pair r, s such that i} fdr and J fds both exist. 


The functions p,, q, are such that p,—q, = g—g(a) (not g). Never- 
theless it is clear that, if fis integrable with respect to p,, q,, then fis 
integrable with respect to g and 


b b ‘b 
[tee = [fe0,- [saa 651) 
for p, + 2(a), q, is a decomposition of g into increasing functions. The 
next theorem shows, conversely, that, if f is integrable with respect 
b b b 
to g, then f Sdp, and ( dq, exist so that fdg may, in fact, be 
defined by (6.51). 


Theorem 6.51. Let g be of bounded variation on the interval {a,b}. If 
fis integrable over (a, b] with respect to g, then f is also integrable with 
respect to each of the variation functions vg, Pgs Jy Of &- 


Proof. Let r,s be two increasing functions on [a,b] such that 
g=r-s and f is integrable with respect to each of r,s. Given 
e > 0, there is a dissection 2 of [a, 5] such that 


SD, f,r)-(D,f,r) < ¢, SD,f,8)-(P,f, 5) < € (6.52) 
and V(Q9, g) > Vi(g)—e = v,(b)—«. - (6.53) 
Since |s(A)—g(@)| < [r(A)—r(@)] + [5(8) -s@)], 
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the two inequalities of (6.52) give (in the usual notation) 


Et mpleed- e019] < 2. (6.54) 


Also, if K = sup |f(x)|, then by (6.53), 
asa<b 
0< 3} (M.—m) efx) —o4erl- le) —a-o)} 


< 2K Eley) —40r-)— led — 2-0} 
= 2K {v,(b)—V(P, g)} < 2Ke. (6.55) 
From (6.54) and (6.55) we now obtain 


3 ,—m) (oe) viv} < AK+ Ne 


and so fe R (v,; a, b). 

As p, = #{v,+g-—g(@} = H{v,+r—s—g(@} is an increasing 
function, exercise 6(a), 4 shows that feR(p,;a, 6). Similarly 
SER (G34, 5). | 


Most of the theorems on Riemann-Stieltjes integration with an 
increasing integrator are easily extended to integration with respect 
to a function of bounded variation. Where there are differences, 
integrators of bounded variation usually lead to a more symmetrical 
result, 

The integral is linear in the integrator as well as the integrand: Jf 
ky, ky are any constants, 


b b b 
[Git+kaAde = hf’ fidetke [de 6.56) 


' b b 
and flashes) = haf Fder+ka [ fdsy 657) 


where in each case the existence of both integrals on the right implies 
the existence of the integral on the left. This is the analogue of theorem 
6.13. We have now removed the restriction k > 0 which was necessary 
in part (ii)(a) of that theorem since integrators had to be increasing. 
Theorem 6.14 takes the same form as before, but the analogue of 
theorem 6.15 does not have quite the appearance of the original. 
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Theorem 6.52. If g is of bounded variation on [a, b] and f € R(g; a, 6), 
then |f| € R(v,; a, b) and 


[7%] < [idee 


Proof. By theorems 6.51 and 6.15, |f| is integrable with respect to 
Ug» Po» Ig. Using also the relation v, = p,+q, and theorem 6.13 we 


| fr4e| < [r, +| saa, 
< ['isldey+ flag = [is lde, | 


Corollary. If. fas| < ube |£@)|. V2(g). 


b b 
Sometimes f Fdv, is written F\dg|. In this notation the con- 
a a 


clusion of theorem 6.52 has the form 


|f74e| < [PA leet. 


Theorem 6.16 holds also for integrators of bounded variation. 
The new version of theorem 6.17 appears with a slightly relaxed 
hypothesis. 


Theorem 6.53. (Change of variable.) Let fe R(g; a, b), where g is of 
bounded variation. If $ is a continuous, strictly monotonic function 
such that $(«) = a and ¢(f) = b, then fo ¢ is integrable with respect 


to go¢ and 
[tae = [ro eyatzo 9. 


Proof. Let g =r-—s, where r, s are increasing functions and 
feR(r; a, b)n R(s; a, b). When ¢ increases the result follows 
immediately from theorem 6.17. When ¢ decreases (so that 8 < «), 
then —(ro ¢) and —(so ¢) are increasing functions and the argument 
of theorem 6.17 shows that 


[ita = [roa —cooy, [sas = fro eyat—o 9) 
a B ‘ a B " 


Hence, using also (6.57) we have 


b a B 
[tae = [ro eat-(eooy = [Fo edge). | 
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Corollary. The function ¢ of the theorem may be taken to be piecewise 
strictly monotonic when f € R(g; c, d), where 
c= inf 4), d= sup ¢(X). 
axt<p 


ast<f 


Lastly we combine the analogues of theorems 6.24 and 6.25. 


Theorem 6.54. (Integration by parts.) If the functions f and g are of 
bounded variation on a, b] and have no common left and no common 
right discontinuities, then f € R(g; a, b), g ¢ R(f; a, b) and 


[isae+ [eat - 1080 -Saa. (6.58) 


Proof. By theorem 6.44, the pairs of functions p, and p,, p, and q,, 
gy and p,, g, and g, have no common left and no common right dis- 
continuities. It follows from theorem 6.24 that fe R(g; a, b) and 
g&©R(f; a, b). Theorem 6.25 and simple algebra now yield (6.58). | 


Improper integrals with respect to integrators of bounded variation 
can be defined in the now familiar way, but the manipulation of these 
integrals may be awkward. The comparison principle does not hold 
for them (see exercise 6(e), 6); nor does absolute convergence imply 
convergence (see exercise 6(e), 7(ii).) 


Exercises 6(e) 


1. Prove theorem 6.21B with the restriction g(x) > 0 removed. (For the corres- 

ponding extension of theorem 6.21 A see theorem 6.85.) 

2. The function fis continuous on [a, 5] and g is of bounded variation. Denoting 

by DZ a dissection 
QAey Sie Se a eehed ey Se 


and by &; any point in [x;1, x;], prove that 
n b 
Pu Ede) -—g@i-D} ~f Sdg 


as (D2) + 0, (See exercise 6(a), 9.) 
3. Let f, > funiformly on [a, 6] and let g be of bounded variation. Prove that if, 
for n = 1, 2, ...,f,€ R(g; a, 6), then fe R(g; a, b) and 
» 
[fae > [fae 
la 
(See exercise 6(a), 13.) 


4. Show that the first mean value theorem (see exercise 6(a), 8) does not hold 
for the RS integral with an integrator of bounded variation. 
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5. Let f be a positive decreasing function on [a, 0) with lim f(x) = 0. Also let 
g be bounded on [a, 0) and of bounded variation ont ery interval [a, X] 
(X > a). Show that, if fe R(g; a, X) for every X¥ > a, then [re exists. 

6. Let f on [7, 0) be defined by 

0 for (2n—1)7 < x < 2n7, 


TOs tig for Inn < x < (2n+1)z. 


co ce 
Show that f 1 d(cos x) exists, but that f f(x)d(cos x) does not. 
” 7 


7. (i) Let the functions f,g on [a, ©) be such that, for every X > a,g is of 
bounded variation on [a, X] and fe R(g; a, X). Show that, if |f| dv, exists, 
a 


then f Sadg exists. 
a 


v2 
(ii) Prove that f ae 
I 


: = sin 
es d(cos x) exists, but that f = d(cos x) does not. 
7 


6.6. The Riesz representation theorem 


Every linear function from R” to R” may be represented by an 
nx m matrix (§3.2). This is one of a group of theorems on the general 
form of linear functions associated with various vector spaces. The 
most famous of these results is the Riesz representation theorem 
which characterizes certain linear functions on the space C [a, b] (of 
real functions continuous on the interval [a, 5]). It fittingly illustrates 
the power and importance of the Riemann-Stieltjes integral. (It is 
not, however, subsequently used in this book and the proof, which is 
difficult, may be omitted without fear of repercussions.) 


Theorem 6.61. 
() To every continuous linear function A: C [a,b] -> R' there 
corresponds a function g of bounded variation on [a, b] such that, for 


every f € C [a, b], " 
Af) = [ite (6.61) 


(ii) Conversely, given a function g of bounded variation on [a, b}, 
(6.61) determines a continuous linear function A: C [a, b] > R’. 


The second part follows immediately from (6.56) and theorem 6.52, 
corollary. The proof of the first part is easy if one can use the fact 
that a bounded linear function on C [a, b] can be extended, without 
change of norm, to a linear function on B [a, ] (the space of bounded 
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real functions on [a, b]). Unfortunately we cannot prove this with the 
tools at our command and we have to content ourselves with a less 
interesting result which, nevertheless, is sufficient to establish the 
theorem. 

The sequence (f,,) of real functions on [a, b] is increasing if, for 
every x in [a,b], the sequence (f,(x)) increases; and uniformly 
bounded if there is a constant K such that | f,(x)| < Kfora<x <b 
and all n. We denote by C, [a, b] the vector space of all (bounded) 
real functions on [a, b] which are of the form 

lim f;, —lim hy, 
where (f,,) and (h,) are uniformly bounded, increasing sequences 
from C [a, 5}. 
Lemma, A real valued, continuous linear function on C [a, b] may be 
extended, without change of norm, to the space C,, [a, b]. 


Proof. Let A: C [a, b] > R! be a bounded linear function. 

(i) Consider a uniformly bounded, increasing sequence (/,,) from 
C [a, b]. The sequence converges and its limit function f is bounded. 

We begin by showing that (A(f,,)) converges. For k > 2, let 


[ 1 if ACK)-AUi-a) > 0, 
Lt Ata Ahal< 0: 


& = 
Then 
E,AG-AGdl = 3 A Ad} 
= (3, ne ~f-0| 
< Lal sup, | 3, aie) 00) 


a<r<b |k=2 

< [Al sup 3 (40)-fral} 
a<xc<bk=2 

= |All sup (4.0) -A@} 
asz<d 

< lA] sup (7@)-AC}, 
agc<b 


ie. the partial sums of = |ACh) —ACf.-1)| are bounded. It follows 


that the series ise 
MA+ BAG) — Ae} 
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converges absolutely and so its sequence of partial sums, i.e. (A(/,)) 
converges. 

(ii) Next, let (f*) be any other uniformly bounded, increasing . 
sequence from C [a, b] which also has the limit f, For n = 1, 2,..., 


put 1 apache | 
Pn =tn-> Pr =fh “Hn 
Then (¢,,) and (¢%*) are both strictly increasing sequences and clearly 
lim A(f,) = lim AG@,,), lim ACfx) = lim A(z). 
Take an integer m,. There is an integer 7, such that ¢,,,(x) < $n,(x) 
for all x in [a, b]. To prove this let F, be the closed set of points x 
for which ¢,,,(x) > $%(x). Since the F, form a contracting sequence, 


if none of them were empty, there would be a point £ common to 
them all (exercise 3(f), 6) and we should have 


bm) > lim $e(6) = S(E). 
But this is impossible since (¢,,) strictly increases, and so there is an 
n, such that F,, = @. Continuing in this way we obtain two sequences 
of integers (7m;), (n;) such that 
dm, < bir < Ping < Pig < s+ 
By (i), the sequence 
Amd» MPns)> Ams)» AMPna)> +++ 
converges and its limit is equal to both lim A(¢,) and lim A(¢z). 
se lim A(f,) = lim ACF). 


We can now, without ambiguity, define A(f) to be lim A(/f,). 

(iii) It is clear that, if f,h are limits of uniformly bounded, 
increasing sequences from C [a, 5], then so are cf, where c is a non- 
negative constant, and f+h. Moreover 


A(cf) = cA(f), ACf+h) = A(f)+A(A). 


We still have to define A(f—h). To do so we suppose that f*, h* 
are of the same type as f, h and that 


f-h = f*—h*. 
Since f+h* = f*+h, we have 
ACP) +Ah*) = ACF) +A), 
Le. A(f)—ACh) = ACf*)—Ah*). 
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Hence we may define A(f—h) unambiguously as A(f)—A(h). It 
follows immediately that A is linear on the vector space C, [a, b]. 

(iv) Any member of C, [a, b] is of the form f—/A, where f, h are 
the limits of uniformly bounded, increasing sequences (f,,), (A,) from 
C [a, b]. To prove that the norm of the extension of A to C,, [a, ] is 
still ||Al| we have to show that 


AG-2| < |All, 
where K = sup |f(x)—A(x)|. We define the functions 
KRew=@i;2,..) 
Su) if | f(x) —hn(X)| < K, 
Su™(X) =) An(QX)+K if fu(™)—hn(x) > K, 
h,(x)-K if f(x) —A,(x) < -K. 


by the equations 


Clearly 
lft()—-h(x)| < KK @a<x<bjn=1,2,...). 


It is also easy to see that the functions f* are continuous and that 
Sx +f. Finally, by considering the various forms that f*,,(x) f(x) 
may take we can show that /;*(x) increases with n. (Exercise 6(/), 1.) 
Hence 


|AG—A)| = |lim ACF) —lim AGh,)| = lim [AGT —Ay)| < ||AIK. | 


Proof of theorem 6.61(i). The functions hy, h,(a < x < 5), hy 
Bivetnby HAjiar Onto are Bs 


< b, 
h(@) = 1 fora<t<b 


all belong to C, [a, b]. This is obvious for h, and hy; in the case of h, 

we need only remark that —h, = lim ¢,, where, for n > 1/(b—x), 

¢,(t) = —1 in [a, x], ¢,(¢) = 0 in [x+(1/n), 5], and ¢,, is linear in 

[x, x+(1/n)] (in the elementary sense—see note at foot of p. 66). 
Let g on [a, 5] be the function such that 


g(x) = A(h;z) (a < x <b); 
in particular, g(a) = 0. 
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If a dissection J of [a, b] has the points of division 
Gimsity Soh ccs tnoe Sal Os 


put e; = 1 or —1 according as g(t;)—g(t;-1) > 0 or < 0. Then 
n n 
19,8) = 3 edatt—etteD} = 2{ 3 ellay—he,.d)} < Pl 


since  edt(o)—My, 091] = 1 


for a < x < b. Thus g is of bounded variation on [a, 5]. 

Now let f be any member of C [a, b] and take ¢ > 0. Since / is 
integrable with respect to the variation functions p,, q, of g and is 
also uniformly continuous on [a, 5], there is a dissection 2 of [a, 5] 
given by Zim Nye Ny Seas Sn, < Xp =D 
which has the following properties: 

b b 
S.f.7)-[' Fae, <&% Sf.4)-| day < 65 (6.82) 


and M,-m,<e (=1,...,”), (6.63) 


where M;,m; denote the supremum and infimum, respectively, of 
SF in [x;., x]. By (6.62), 


|B Mtecs)—eesvi-[sde|< 26% (664) 
while, by (6.63), the step function 
$= 3 Milley.) 
is such that up, Ife)-9@)| < € 


and therefore |A(f)—A(¢)| = |AU/—9)| < Alle. (6.65) 
But 


AG) = 3B Mids) -Mle,.)} = E Mites) #0} 
and so, by (6.64), a) -['s ds| < 26, 
Using also (6.65) we finally have 


Acf)= J’ fae| < (AL+2)¢ 
which proves (6.61). | 
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Exercises 6(f) 
1, Prove that the sequence (/*), defined in part (iv) of the proof of the lemma, is 
increasing. 


2. A necessary and sufficient condition for the function ¢ of bounded variation 
on [a, 5] to be such that b 
[1-0 
la 


for all fe C[a, b] is that 4(b) = (a) and ¢(x) = d(a) when x is a point of 
continuity of ¢ in (a, b). 

Prove the necessity of this condition by considering the functions f, f,,3 
defined as follows: 

@) f(t)=1fora<t<b; 

(ii) when x is a point of continuity of ¢ in (a, b) and 0 < 6 < b—x,f,3(t)=1 
fora < t < x,fz,9(t) = 0 forx+6 <4 < band f,,, is linear in [x, x+4]. 

Prove the sufficiency of the condition by using exercise 6(e), 2. 


3. Let ¢ be a fixed point in the interval (a, 6) and define the linear function 
A: Cla, b]> R* by Af) = fC. 


Enumerate all the functions g which have the property that 


oe, ry 
aay = [fade eC ta, bb. 


6.7. The Riemann integral 

In the rest of this chapter we develop the theory of the Riemann 
integral. Our first task is to reconcile the definition of the integral 
given in Cl and the definition in terms of upper and lower integrals 
given in §6.1. The instrument for this is Darboux’s theorem, a proof 
of which was indicated in C1 (125). The reader is reminded that, 
given a dissection 9 of an interval [a, b], “(P), the mesh of J, is 
the length of the largest subinterval; and S(Z, f), (2, f) denote the 
upper and lower Riemann sums of a bounded function f on [a, 5]. 


Theorem 6.71. (Darboux.) If the function f on [a, b] is bounded, then, 
as (2) + 0, 


To ’ 
OIAN=[4 Gd NF 
Proof. Let 2 be the dissection of [a, b] given by 


B= Xo < Xy <s10< Xpyny S My =O 


and let 2’ be the dissection with additional points of division 
x), x, ...,x”, where 


Keg SRO SOS ee 
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Denote, as usual, by m, M, m;, M; the infima and suprema of f on 
[a, b] and on [x;_,, x;] respectively. Also let M, M®, ..., M%+» be 
the suprema of f on the k +1 additional subintervals of ’. We then 
have 


0 < S()-S(@’) 
= M((x;—x;-1) 
= {M(x — x54) + M(x — x) +. + MEN, — x} 
< M(x —X,-1)— (Xj; — Xi) < (M—m)(x;,— x). 


Hence, if D* is any dissection obtained from D by adding new 
points of division, 


0 < SD)—S(B*) < (M—m) =* (x;-x;-1), (6.71) 
where =* ranges over the intervals containing new points of division. 
Now, given e > 0, there is a Dy such that 


S(Do) < [ir é. 


Let no be the number of subintervals of 2, and take 3 so that 
0 <6 < en. 


Let 2; be a dissection with “(D;) < 6 and let D* be the dissection 
with all the points of division of Dy and of Z;. Then 


S(D*) < S(Do) 
and, by (6.71), 


0 < S(Q,)—S(B*) < (M-m)n,o < (M-m), 
since at most my points are added to 2, to form Y*. Therefore 
[7 < SD) < S(D*)+e(M—m) 
< S(D,)+e(M—m) < [7eea+ae—my, 
ice. [rs S(D,) < [frea+m—m. 
This proves (i). The proof of (ii) is similar. | 


Theorem 6.71 does not extend unrestrictedly to the Riemann- 
Stieltjes integral; but the analogue is valid if the integrand or the 
integrator is continuous. (See exercises 6(a), 9; 6(g), 1 and 2.) 
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The next theorem establishes the equivalence of the two definitions 
of the Riemann integral. In it we use the standard notation 


Gm Xp SX Ses ne Se 


for a dissection 2 of [a,b] and, for i = 1,...,n, we allow &; to 
range over all points of [x;-, x;]. 


Theorem 6.72. 
(i) If f is integrable over (a, b), then 
EAEu—md > [if as mB). 
i=l a 
WF EAD G—m>e as M90, 


then f is integrable over [a, b] and | f=c, 
a 


Proof. 
(i) For every set of &;, 


92) < 3 MEN— x) < SC) 


and, by theorem 6.71, (2) > ' *f S(D) > I *f a8 WD) 20: 


(ii) Take any ¢ > 0. Given 9, we choose, for each i, the points 


&;, ; so that 
SE) > M;-€ and f(§i) < m+e. 


Then EMEC Ha) > (D)-eb—<) 
and EAE Ci- Ma) < 8D) +4b-a), 
so that 


ENOCH x)--a < (9) < [Ff 


< [7 < 19) < 3 AVX) +b-a) 
Letting “(2) > 0, we obtain 


b Te 
o—e(b—a) < f f< | f<ot+eb—a). | 
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Exercises 6(g) 
1. Show that the analogue of Darboux’s theorem holds for the RS integral with 
a continuous increasing integrator. 


2. Give an example of an increasing function g on an interval [a, 6) and a 


function fe R(g; a, 6) such that lim S(Q, f, g) does not exist. 
Ma)—>0 


3. Let be continuous on [a, 5]. Show that fis of bounded variation on [a, 5] if 


and only if lim V(Q,/f) exists; and that, if the limit exists, then it is vif). 
MQ)—>0 


4. Give an example of a function / which is of bounded variation on [a, 6], but 


such that lim V(@,f) does not exist. 
2)—-0 


5. Deduce from theorem 6.71 that, if a < b <c, 
To Fe Fe b e e 
Por fire fix ana flr fr [oe 
a b a ga Jb da 
6. The function f is continuous and strictly increasing on [a, 5]. Show that, if 


Sa) = %, f(b) = 8, then, ag 
fa f f> = bB-az. 


6.8. Content 


It is easy to see that a bounded function with only a finite number 
of discontinuities is Riemann integrable (see exercise 6(h), 1). We 
show in the present section that this remains true for suitably 
restricted infinite sets of discontinuities. The extension of our results 
to multiple integrals will play an essential part in chapter 8. 


Definition. Let X be a set. If E is any subset of X, the function 
Nn: X > R given by 


E, 
he oo { for x€ 


0 forxeX-E 


is called the indicator (or characteristic) function of E. 
In this section we always take X to be R°. If, for instance, E = [a, A], 
ll Mfowem cm, 8, 
Xa, a) = 
lo for x < aorx > f. 


Now let [a, 6] > [a, 4]. Then 
[ineneddr = pa, (681) 


'b 
(In particular, f Xx = 0 when £ has just one point in [a, ].) For, 
a 
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ifa<a<£<b and @ is a dissection of [a, b] containing «, £ 
as poi nts of division, then 


b To 

p-a= 52) < [xen < J tan <2) = P-atd+8, (682) 
ga a 

where 6, 6’ are the lengths of the two subintervals of J adjoining 


[a, 4]; and, ifa = «orf = 5, then (6.82) holds with 6 = 0 or 6’ = 0, 
It is proved similarly, or from (6.81), that 


b 'b 'b 
i Xap) = f Xa,A) = f Xa, = Be. (6.83) 
a a a 


Also, if E is an arbitrary bounded set in R? and [a, 5], [a’, b’] are any 
intervals containing E, then, by the lemma preceding theorem 6.16, 


To To b v 
[xe = [xe fixe = [xe 
a q’ Ja Ja 
This consideration and the identities (6.81) and (6.83) lead to an 
extension of the notion of the length of an interval. 


Definition. Let E be any bounded set in R'. The outer Jordan content 


po 
C(E) of E is the common value of J Xx for all intervals (a, b] containing 


b 
E; the inner Jordan content c(E) is the common value of J Xz: If 


c(E) = C(E), this number is called the Jordan content of E and is 
denoted by c(E). 
If the set E has content, then yz, is integrable over any interval 


6 
[a, b] containing Zand | yz has the same value for all such intervals. 
a 


We have shown that the content of a finite interval is its length. 
An example of a bounded set that does not have content is the set of 
rational points in a finite interval. 

Although we have defined content in general, in this section we are 
mainly interested in sets of zero content. 


Theorem 6.81. The bounded set E has zero content if and only if, 
given é > 0, there is a finite number of open intervals, or a finite 
number of closed intervals, which cover E and whose total length is less 
than e. 
Proof. Let E < [a, 6}. 
(i) Suppose that c(£Z) = f Xz = 0. Then, givene > 0, there isaD 
a 
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such that S(2, xz) < €; and S(2, xz) is clearly the sum of the 
lengths of the closed intervals [x;_,, x;] which contain points of E. 

Each [x;_1, x;] may be replaced by a slightly larger open interval 
so that the total length of the open intervals is still less than e. 

(ii) Suppose that, given ¢ > 0, there are open intervals Jy, ..., Jn 
covering E and of total length less than e. Since a pair of overlapping 
intervals may be replaced by a single open interval, we may assume 
that J, ..., J, are pairwise disjoint. Their end points (between a and 
5) determine a dissection of [a, b]. Since [a, b]—(1, U ... U Z;,) con- 
tains no points of E, S(2, Xz) < ¢. Hence c(E) = 0. 

If we had started with closed intervals, we could have enlarged 
them slightly into open intervals. | 


That every finite set has zero content followed already from (6.81). 
It is now easy to see that a bounded infinite set with no more than 
a finite number of limit points has zero content. (See exercise 6(h), 3.) 
For instance, if E = {1, 4, 4, ...}, c(Z) = 0. 

Theorem 6.82. If f is bounded on [a, b] and the set E of points of dis- 
continuity of f has zero content, then f is integrable over [a, b). 
Proof. Given € > 0, there is a finite number of pairwise disjoint 
open intervals /,,..., J,, of total length less than e, such that 
G=U...Uh,> £. 
The function f is continuous on 
H = [a, b|-G = [a, b]nG’ 
and, since H is bounded and closed, fis uniformly continuous on H. 
Thus there is a 6 > 0 such that | f(x)—f(x’)| < ¢ whenever x, x’ ¢ H 
and |x—x’| < 6. 

Now let J be a dissection of [a, 6] which contains all the end 
points (in [a, 5}) of ,,..., J, and all of whose subintervals in H are 
of length less than 6. If the subintervals of D are [x;1, x;] (i = 1, ..., m) 
and M,, m;,, M, m have their usual meaning, 


S(@)-s9) = 3 (Me—m) Oe) 


(fat 2x) (Mi—m,) (%—x;:-1), 
where Lg and Ey run over the subintervals in G and H, respectively. 
Clearly 

Zq(Mi—m;)(X;— Xia) < Ug(M—m)(%;— Xi) < (M—m)e 
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and 
Ly (Mi-—m,)(%i—Xi-) < Dy e(%:—Xi-1) < e(b—a). 


Thus S(Q)-s(B) < (M-—m+b—-a)e. | 
Theorem 6.83. Suppose that f and g are bounded on [a, b| and that 


F(x) = g(x) except when x belongs to a set of zero content. Then either 
both f and g are integrable over [a, b] or neither is integrable; and, if f, 


g are integrable, " . 
lo-fi 
a a 


Proof. All that is necessary is to show that h = f—g is integrable 
and fi =0. 
Let E be the set of points £ such that h(£) + 0 and let M, m be the 
supremum and infimum of / on [a, b]. Then 
mxx(x) < h(x) < Mxz(x) 


for a < x < band 50, since c(E) = 0, 


b b b To b b 
O= mixes = fom < fis [ih < ['Mxe=M [xe = 0. | 
a a Ja a a a 


The theorem shows that, as far as integration is concerned, sets 
of zero content are immaterial. It is therefore legitimate, and some- 
times convenient, to leave a function undefined in a set of zero 
content. For instance 

t, 1 
J sin — dx 
Cea 3 


has a definite meaning without the integrand being defined at x = 0: 
whatever value is assigned to the integrand at 0, the integral exists 
and its value remains unaltered. The next theorem similarly illustrates 
the utility of this feature of the Riemann integral. 


Theorem 6.84. Let the function f be continuous on the closed interval 
[a, b] and differentiable in the open interval (a, b). If f' (which need not 
be defined at a or b) is integrable over [a, b], then 


[if =10-f00. 


(This is a stronger result than theorem 7.63 of C1.) 
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Proof. Let @ be the dissection of [a, b] given by 
Di epee eke Sy 


By the mean value theorem, 
SO-f@ = B (fi) —fCi-D} = af (Ei) (%i- Xia) 
where x;1 < & < x; (i = 1,...,”). Since f’ 1s integrable, theorem 


b 
6.72(i) shows that the right-hand side tends to i Sf’ as (QD) +0. | 


In the above proof the use of theorem 6.72(i) (and so of Darboux’s 
theorem) is convenient, but not essential. (See exercise 6(h), 10.) 

Theorem 6.84 means that, if f’ is integrable, then f is an indefinite 
integral of f’. It therefore shows that theorem 6.21A is included in 
6.21 B. Equally, the following convenient extension of theorem 6.21A 
is only a special case of exercise 6(e), 1. 


Theorem 6.85. Let f < R (a, b) and let g be continuous and of bounded 
variation on {a, b). If g is differentiable in (a, b) and g' € R (a, b), then 


ay id 
fe R(g; 4a, b) an [ive os [iw 


Exercises 6(A) 


1. The function f on [a, 4] is bounded and is continuous except at a finite 
number of points. Prove, without using the notion of content, that fis integrable 
over [a, 5]. 


2. Show that, if [e, 7] < [a, 5], then 
b 
i Xa, py = P-% 


a 


3. Show that a bounded infinite set with a finite number of limit points has zero 
content, 


4. Given any set E, let E® be the set of limit points of Z and, for n = 2, 3, ..., 
define E® to be the set of limit points of E”-». Show that, if E is bounded and 
E is finite, then c(E) = 0. 


5. Let E,, E, be subsets of R'. Prove that 
Xe, yx) = max (Xp (Xs Xe) Xz,q 2,0) = min (Xg,0), Xz,00). 
Assuming the identities 
max (a, b) = }{(a+b)+ |a—6|}, min (a, b) = 4{(a+b)— |a—5]}, 
show that, if c(E,), c(E,) exist, then so do c(E, U E,), c(E,  E,) and 
C(E, U Es) + c(E, 0 Ex) = c(E\)+ c(E2). 
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6. Prove that, if c(E,) = = c(E,) = 0, then c(E,U...U E,) = 0; and show 
that the relation c(E,) = 0 (m = 1, 2, ...) does not imply that c(Z, U E, U...) = 0. 


7. The functions f, g are bounded in [a, 5] and f(x) = g(x) in [a, 5] except for x 
in a set of zero content. Prove that 


Iie-[ie [-Le 


fe) = >» J sin 


n= —nx* 


8 For x + 1,4,3,...5 


Show that fis integrable over [0, 1]. 


9, The function fon [a, 5] is given by 
0 if x is irrational, 
1/q if x = pq, 


where p,q are coprime integers. By finding a sequence of integrable functions 
converging uniformly to f, or otherwise, prove that f is integrable over [a, 5]. 
(It was shown in §3.1 that f is discontinuous at all rational points of [a, 6). 
The set of discontinuities is therefore not of zero content, which shows that the 
converse of theorem 6,82 is false.) 


F(x) = { 


10, Prove theorem 6.84 without using any results from §6.7. 
11. The function fon [0, 1] is given by 

0 forx = 0, 
xsin(logx) for0<x <1. 


f@) = | 


Prove that f is differentiable in (0, 1], but not at 0, that f’ is integrable over 
[0, 1] and that "i 
[r-o 
0 


12. Show that the function / on [0, 1] given by 


0 for x = 0, 
f@ = 7 


sin >a for0<x <1, 
is cliterentie bie in [0, 1]. Show also that f’ is not integrable over [0, 1], but that 
i f’ exists and is 1. 
0+ 


13. The function f has a continuous derivative in the interval [a, 6]. Show that f 
is the difference of two increasing functions with continuous derivatives in [a, 5]. 
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6.9. Some manipulative theorems 
The first theorem of this section is the most useful version of the 
formula for integration by parts. 


Theorem 6.91. Let f,g be integrable over [a,b] and let F,G be 
indefinite integrals of f, g respectively, i.e. functions given by 


Fs) = [iroa+n, G(x) = [soa+z (a<x<bd, 
where K, L are arbitrary constants. Then 
i) ” {G+ i ” Fe = F(b)G(b)— F(a) G(a). (6.91) 


Proof. Since F,G are continuous and of bounded variation 
(exercises 6(a), 10; 6(d), 4), the result easily follows from the theorem 
on integration by parts for the RS integral (theorem 6.54) and from 
theorem 6.21B as extended in exercise 6(e), 1. However a direct 
proof is also desirable. 

We first note that the continuity of F and G ensures the existence 
of the two integrals in (6.91). 

For any dissection 9 of [a, b] given by 

B= yg ee a a 
we have 


3 axa [" senaet 3 red) [i sear 
i=1 Bar i=1 Cina 


3, Geo) -Fi)}+ 3 FOr) Gd - Ge) 


E (Fe) G(x) - Fond} 
= F(b)G(b) — F(a) G(a). (6.92) 
We now show that 


é Gx) f= fixdx > if G(xofdx as (D)+0. (6.93) 


The function G is uniformly continuous on [a, 5], i.e. given e > 0, 
there is a 6 > 0 such that 


|G(x)—G(x’)| < ¢ whenever x,x'e[a,b] and |x—x'| < 6. 
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Thus, when (2) < 4, 


| f ; Ge) foxax— G(x) af a) dr| 


=| 3,f" 6)-G0%9) fede 


< 3 [ |6c)-G¢xo) |feolax 


n xi '» 
< 3 f° elraias = ef [scala 
This proves (6.93). Similarly 
oa F(X;-1) ie a(x)dx > f Rade as “(D)>0. (6.94) 


Letting “(2) > 0 in (6.92) and using (6.93) and (6.94) we obtain 
(6.91). | 

The formula (6.91) with continuous fand g was proved in C1 (130) 
and has been used by us on previous occasions. The proof under these 
assumptions is very simple, but the strength of theorem 6.91 lies in 
the hypothesis of mere integrability. 


Theorem 6.92. (Change of variable.) Let f be integrable over [a, b] 
and suppose that ¢ on [a, f] satisfies the following conditions: 
(i) ¢ increases on [a, 3] and 


$(%) =a, (8) = b; 


(ii) 9’ exists in and is integrable over [x, A). 


= [r= [ions 


ie. fir dx = i: : fid(D}o'(dat. 


Proof. When ¢ is strictly increasing this is easily deduced from 
theorems 6.17 and 6.21A. A proof of the theorem as stated, and 
independent of the Stieltjes integral, proceeds as follows. 

Let be the dissection of [a, 6] given by 


B= Xo SX SS Kee sy, aD, 
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For each i, choose a f; such that A(t;) = x,. The ¢; are not necessarily 
unique (unless ¢ is strictly increasing), but we always have t;, < 1. 
For simplicity, take tj = «, t, = £. Note that, by theorem 6.84, 


moa = Hla) =f ¥ Ode 
As usual, let sa 
m= int fix) = inf flo) 


T—-1S SY 


M,= sup f(x) = sup f{d(o}. 
&-.<t<t; 


TiS ESN 


Then, since #'(t) > O fora <t< f, 


n n ty 
§9,f) = ¥ mbxi—xea) = 3 [mood 


ti 


< Bf roo eoa = [rosa 


TA n Th 
< | romeo = 3 |" reoeoa 


f=1d¢ 
n ti n 
<2 M,?¢'(dt = 2 M((x;-x:4) = S(Q,f). 


i=lJ4-. 


Now s(Q, f) and S(Z, f) can be taken arbitrarily close to [ f. Hence 


B b 
i} (fo ¢)¢' exists and is equal to J fil 
a a 


A similar theorem holds for a decreasing function ¢ and therefore 
also for a piecewise monotonic ¢, provided that fis integrable over 


[c,d], where = _ ing g(), d= sup (0). 
a<t<p a<t<p 
There are other sets of conditions for changing the variable. For 


instance, when f is continuous, ¢ need not be piecewise monotonic 
(see exercise 6(i), 1). 


If fis integrable over [a, b], then there is a number A between the 
infimum and the supremum of / on [a, b] such that 


[r- Xb-a). 


This rather obvious statement is usually called the first mean value 
theorem. However the second mean value theorem is more interesting. 
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Theorem 6.93. (Second mean value theorem.) Suppose that g is 
integrable over [a, b]. 
(i) If f is non-negative and decreases in [a, b], then there is a & in 


{a, b] such that a ' 
[#-s0 ‘se. 


(ii) If f is non-negative and increases in [a, b], then there is an 7 in 


[a, b] such that " > 
[ie -70 |e. 


Proof. 
(i) Let K= sup |g(x)|, 
asax<b 


so that g(x)+K > 0 for a < x < b. Then, for any dissection D 


iven b 
g y A= Xp < % <...< Xp < X = B, 


[ive+m = Sf" fe+® < Sfed f+") 
a i=1J 2-1 i=l M1 
= Epon f” 8+ K Efex). 695) 


If Gx) = [se 


then, since G(a) = 0, f decreases, and f(b) > 0, 


fod” ¢= 3 AeNGer)-Go 
i=1 Tima i=1 


E £1) Ge) —"S flor) G(x) 
i=1 i=0 


& Merd-S0)} 60) +060) 


IN 


EV ed -Ld} sup, 60) +060) 
= (£@)-/0)} sup, G(x) +/0) 4) 
phe ae 


Ako 3S fideo ad ['f as m9) +0. 
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Hence, letting “(Z) > 0 in (6.95) we obtain 


'b 
[ife+") < f(a) sup Go+K { ie 
a . asasb a 
ie. [. < £@ sp, G00. 6.96) 
a asa<b 
Applying (6.96) with g replaced by —g we have 
[AE < 1@ sup, {-GO)} = —Ma) int, GO, 
a aga<b aga<b 


so that i ” fe > fla) inf G(x). (6.97) 
a asa 


Since G is continuous, (6.96) and (6.97) show that there is a & in 
{a, 6] such that » a 
fie - race - Fo fe. 


(ii) This can be proved by an analogous argument or by applying 
(i) to f(6—x) and g(b—x). For then there is a £ in [0, b—a] such that 


[10-9 96-m4x = £0 [0-20 dr 
and theorem 6.92 (with decreasing ¢) gives 
[rasta = 10) [aoa 
where 7 = b—£. | 


Corollary. If g is integrable over [a,b] and f is monotonic in [a, b], 
then there is a & in [a, b] such that 


[ie -s0 f'e+20 fe. 


Proof. Suppose that f decreases. Then f—/(b) is non-negative and 
decreasing so that, by the theorem, there is a & in [a, b] such that 


b 6 
[users = r-10[s. 


f fae=ro fiero {f'e-f'e}-10 [i2+s0 [eI 


Note. Theorem 6.93 may be extended to RS integrals with con- 
tinuous integrators. (See exercise 6(i), 4.) 
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The second mean value theorem is often used to establish the 
existence or uniform convergence of improper integrals. The analogues 
for integrals of Dirichlet’s and Abel’s tests may be deduced from it 
(see exercises 6(i), 5,6), but the following example shows that a 
direct attack is simpler. 


Example. The integral ‘ 
i aes (6.98) 
bre 
Convergence of the integral. The integral converges for all values 
of y. To prove this we first remark that the integral is not improper 
at 0, since the integrand is continuous and bounded on (0, 00). Also 
we need only consider the case y + 0. Then, when X, > X, > 0, 


Xe 3 j 
If an ae ihe | = lz; sin xyde < rar (6.99) 
1JX% 1 


and 2/(X,|y|) may be made arbitrarily small for all sufficiently 
large X,. The general principle of convergence (theorem 6.31) 
therefore shows that (6.98) exists. 

We had previously proved the existence of the integral (with y = 1) 
by using integration by parts. In fact both methods are frequently 
applicable. 

Uniform convergence of the integral. The integral converges uni- 
formly in any set of the form |y| > c > 0. For, by (6.99), 


*sin x 4 
sup is dx 
lul2e * ie 1¢ 
and we can now use the general principle of uniform convergence 


(theorem 6.34). 

The convergence of (6.98) is not uniform in any interval containing 
the point y = 0, Consider, for instance, the interval [0, 1]. Take any 
X > 1 and let u = 7/(4X). Then 


2X sin xu 2X sin far 
ifs : dx > [= dx = 75 log2. 
Therefore, for every X > 1, 
2x 
sup ) sins dx ®| > J Ja log 2 
O<y<l x 


and theorem 6.34 shows that the integral does not converge uniformly 
on [0, 1]. 
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Value of the integral. We prove that 
: —4n for y <0, 
[po ae = 0 for y=90, 
4n for y>O. 


Given y, denote the value of the integral by. é(y). It is clear that 
¢(0) = 0 and 4(—y) = —¢(y). Moreover, if y > 0, 


X ef: XY oj 
J 072 ax = [ USI pes gl) as X > ©, 
0 x 0 t 


and so 4(y) = (1). Hence we need only show that 4(1) = 47. 
Forn = 1, 2,..., put 


i, 4 sin 2nx 
Un = I sin 2nx cot xdx, U, = ) ee dx, 
0 0 


The following three steps establish the required identity: 
@) u, =47; i) Tim(@,—-v,) =0; iii) lim v, = (1). 
no no 
(i) is proved by induction. We have 


bn 
Uy =f 2 cos? xdx = 47; 
0 
bn 
Unji—Un = i 2 cos (2n+1)x cos xdx 
0 


4 
= I {cos (2n+2)x+cos 2nx}dx = 0. 
0 


(ii) Since x-!—cot x and —(x~*—cosec* x) converge as x > 0+, 
by theorem 6.84 the former is an indefinite integral of the latter. 
Hence, by theorem 6.91, 


tn 
Up_—Up, = J sin 21x (j,-eot x) dx 
0 


= [- 2nx (i -cot x)" 4 cos 2nx (1 a \y 
zi ape odo an (a cOsee* x) dx 


>Oasn>o. 


(iii) follows from the identity 


mm sin t 
t; = J — dt. 
o t 
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Exercises 6(i) 


1. Suppose that the functions f, ¢ satisfy the following conditions: 

(i) ¢’ exists in and is integrable over an interval [«, /)], 

(ii) f is continuous on [c,d] where c, d are, respectively, the infimum and 
supremum of ¢ in [«, /]. 

Show that, if ¢(@) = a and ¢(f) = b, then 


[ire [icone 


(In C1, 130, ¢’ was taken to be continuous.) 


2. Frullani’s integral. The function f on (0, 00) is integrable over every interval 
[6, X](6 > 0) and f(x) > /as x + 0+, f(x) > Las x > c, Show that, if a, b > 0, 


a © flax)— fbx) 4 


a 
Ie = = (L—I) log; 


3. Prove the following versions of the second mean value theorem and its 
corollary: 
Under the conditions of theorem 6.93 (i) there is a & in [a, 6] such that 


[ie = f(a+) [ie 


Under the conditions of theorem 6.93 (ii) there is an 7 in [a, 5] such that 


[e-s10-) [ie 


Under the conditions of theorem 6.93, corollary there is a & in [a, b] such that 
' 13 b 
fe=ror fie +10 fe. 
a a € 


4. Show that the second mean value theorem holds for RS integrals with con- 
tinuous integrators of bounded variation: if g is continuous and of bounded 
variation on [a, b] and if f is non-negative and decreasing on [a, 5], then there is 
a number & in [a, 5] such that 


> 3 
[fae = 10) [ae = farie®-e0a). 


Give an example to show that the result becomes false if the condition that g is 
continuous is omitted. 


5. The functions f, g on [a, ©) are such that 
=z 
(i) ) f exists and is bounded for x > a, 
a 
(ii) g is monotonic on [a, ©) and-g(x) + 0 as x > ©, 


co 
Prove that J fg exists. 
a 
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6. The functions f, g on [a, 0) are such that 


(0) { Sf exists, 
a 
(id) g is monotonic and bounded on [a, ). 


co 
Prove that i} fg exists. 
la 


7. Show that 
<0 
I sin (x*) dx 
1 


converges when |a| >1 and diverges when |a| <1. 
8. Show that all the following integrals converge: 


o sinx - x sin x 
(@) f crane oa @) f (eel) Geran oe 


(c) ( maces Cees (da) Jf 00s xin ds. 


log x 


9. Show that 
© sin x 


jo x+y 


co 

wee 
J, e-™” sin — dx 
0 y 


converges uniformly for y > 0. 


converges uniformly for y > 0. 
10. Show that 


NOTES ON CHAPTER 6 


§6.1. Riemann’s theory of integration was published posthumously in 1867. He 
defined the integral as lim = f(&;)(x;—x;-,) (cf. theorem 6.72); upper and lower 
sums and integrals were introduced subsequently by Darboux. Stieltjes’s idea 
of integrating one function with respect to another was initially hidden in a long 
and now famous paper of 1894 on continued fractions. The importance of the 
integral was recognized only fifteen years later when F. Riesz used it in his 
representation theorem (6.61). 


§6.3. It is easy to see that, if | Sdg exists, then 
-@ 


x 
jim, xf *) 


exists and is equal tof” fdg. On the other hand, (*) may exist without f° Sdg 
existing (e.g. when f(x) = g(x) = x). In this case (*) is called the principal walle 
0 
of J fdg and is denoted by (P) | Sdg. 
-© 
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b 
Similarly, if f is unbounded near the point u€(a, 5), (P) i fdg is defined as 
a 


uh b 
lim (f +f ) fae 
h>0+ \da uth, 
‘b 


when this limit exists, but the improper integral if fdg does not. For instance the 
a 
‘1 ‘1 
improper integral | 1 ax does not exist, but (P) i: tax does, 
Ly -1 


§6.4. The concept of a function of bounded variation is due to Jordan (1893) 
who used it for the characterization of curves of finite length. (See §8.1.) 


§6.6. Riesz’s theorem 6.61 has been followed by many similar theorems in- 
volving other types of spaces. For instance let / be the space of complex 
sequences x = (x,) such that © |x,| converges. Then every complex -valued 
linear function f on / is of the form 


L(x) = DenXn, 


where the sequence (c,) is bounded. This representation theorem and others are 
given by Banach in his book Théorie des Opérations Linéaires (61-68). 


§6.8. It is pointed out in exercise 6(h), 9 that the converse of theorem 6.82 is 
false. However a modified form of the condition in the theorem is both necessary 
and sufficient for Riemann integrability. A set EZ in R' is said to have zero 
measure if, given ¢ > 0, there is a countable set of intervals (a, b,) such that 
U(@,, bn) > E and X(bp—a,) < €. 

Theorem 6.81 shows that every set of zero content also has zero measure. On 
the other hand, a set of zero measure need not have zero content; the set of 
rational numbers in an interval is of this kind. The improved version of theorem 
6.82 is that a bounded function is Riemann integrable if and only if its points of 
discontinuity form a set of zero measure. 

It is curious that such a satisfying result on the Riemann integral should use a 
concept from Lebesgue integration, For measure, of which we have given the 
simplest example, is a generalization of content and it is related to Lebesgue 
integration in the same way as content is to Riemann integration. The essential 
advance which the idea of measure marks over that of content is that content is 
only finitely additive, whereas measure is completely additive. By this is meant that, 
if Ey, ..., E, are pairwise disjoint sets with content, then 

(EU... U Ey) = c(Ey)+...+c(En) 
(see exercises 6(h), 5, 6); but, if (E,) is a sequence of pairwise disjoint sets possess- 
Ing measure, then ry FU...) = (B+ mE) + a 
(where m(E) denotes the measure of E). 

The Riemann theory of integration is attractive, simple, and adequate for 
many purposes. However the Lebesgue theory, though more elaborate, provides 
not only a more powerful integral, but one which in many ways is also simpler to 
manipulate. Since 1902, when Lebesgue published his first results, a good many 
other integrals have been developed to solve various specific problems in analysis 
but none has that unique combination of properties which makes the Lebesgue 
integral pre-eminent. For a short account of the Lebesgue integral see J. C. 
Burkill, The Lebesgue Integral or R. G. Bartle, The Elements of Integration. 


7. 
FUNCTIONS FROM R”™ TO R" 


7.1. Differentiation 

It is desirable to express a number of results in this chapter by 
means of matrices. We shall therefore conform to the practice in 
matrix algebra of regarding points in R” (vectors) as column matrices. 
If x € R”, we denote the components of x by x}, ..., Xm; and, to save 
space, we write x = (Xj, ..., X,,)”, where the superscript T indicates 
transposition. Similarly, a function f with values in R” is written as 
(fy «+s fy)". The origin of any space R” will be denoted by 9. (It 
will always be clear from the context to which space the symbol 0 
refers.) Since subscripts are now used to identify coordinates, we 
shall often use superscripts to designate different vectors. For 
instance a sequence of vectors may be denoted by (x, x?, ...) or (ocx): 

Our aim is to define the process of differentiation for a function 
from R™ to R. Before doing so we consider the particular cases 
m=landn=1, 

Vector valued functions on (subsets of) R! present no difficulty. 
If X is a subset of R! and € is an interior point of X, the function 
Sf = Sy vs Sy)": X > R” is differentiable at ¢ if 

imSEtD-SO 
n—0 h 
exists, i.e. if there is a vector f’(£) such that 


je =K\-F (Hh 
h 


>0 as h-0. 


Evidently /’(£) exists if and only if /4(&), ...,fn(£) all exist, and 
f°) = Si,» FnlB))” 
Note that f’ is again a function from R* to R”. 

For functions from R” to R! the notion of a partial derivative 
is familiar. If we regard partial differentiation as differentiation along 
a line parallel to a coordinate axis, we are immediately led to the 
idea of differentiation in an arbitrary direction. 

Definition. Let & be an interior point of a subset X of R and let u 
be a unit vector in R™ (i.e. U = (Uy, «+65 Um)” is such that 


lull = V(@2+... +0) = 1). 
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Given the function f: X > R', if 

im E+) SE) 

10 t 
exists, then this limit is called the derivative of fin the direction u and 
is denoted by D,,f(&). 

Clearly the partial derivatives of f are the derivatives in the 
directions 

Oh tw (15.0255: 0) 25 eB em (OSeDS Siey Ol areeeg le ent (0)10, cre, hee 
We shall generally use the expressions D,f, D.f, ..., D,,f for them, 
since the classical notation for partial derivatives can lead to con- 
fusion. 

In spite of possible first appearances, the directional derivative is 
not the counterpart of the derivative of real functions. For instance 
the existence of all directional derivatives at a point does not ensure 
continuity at that point. For let the function f/: R® > R' be given by 


or when (x, y)” + (0, 0), 
S(x,y) = yet 
0 when (x, y)” = (0, 0)7. 
Then, if w2+v? = 1 and ¢t + 0, 
SI (tu, tv) —f(0, 0) es uv 
t 


ust? +p?’ 
ee a [ le when v + 0, 
es Pri flO, 0) = \ QO when v = 0. 
However f(x, x?) = 4 for all x + 0 and so f is not continuous at 


(0, 0)7. 

In C1 (156) the property of differentiability of a function from R? 
to R! was defined. The definition is easily extended to functions from 
R™ to R'. If X is a subset of R” and & = (&,, ..., &,,)” is an interior 
point of X, the function /: X > R! is said to be differentiable at & 
if there are constants aj, ..., @ such that 

FErt+ My 0009 Sm tlm) —fEry +009 $m) = (Gry + + Am Am) 

NUB+ ... +h8,) ei 
as /(Ai?+...+h?,) +0. The motive for this definition is that, if f 
is differentiable at £ = (&,,...5 m=)" and if f(Eq «+. &m) = Emap 
then the surface X41 = f(x, ..-; X») in R™*! has the tangent plane 


Xmsa—S (Sas «+9 bm) = @(%1 = $1) = + — A(X = $m) = 0 
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at the point (£,, ...; ns Eni). (Here we have used the terms surface 
and tangent plane in an intuitive sense; surfaces are not, in fact, 
discussed in this book.) 

We have previously noted (see p. 40) that every linear function 
A: R” > R' is given by a formula 

A(X) = CpXp eee Fm Xm (= (Nyy «oy Xm)” | -R™) 
where ¢j,..., Cm are constants. Hence the condition (7.11) for 
differentiability can be put in the form: 
ea +0 as Al) >0 

for a suitable linear function A on R” to R}. The definition of differ- 
entiability of a function from R” to R” now follows quite naturally. 


Definition. Let X be a subset of R™ and & an interior point of X. The 
function f: X > R” is said to be differentiable at & if there exists a linear 
function A: R™ > R” such that 


WELDON 9 as +0 (712) 


(where the norms in numerator and denominator are those in R” and 
R® respectively); the linear function A is called the linear derivative of 
fat & and is denoted by Df(é). 

To justify calling Df(x) the linear derivative we need the following 
uniqueness theorem. 


Theorem 7.11. If f:X > R" (where X < R") is differentiable at &, 
then the linear derivative of f at § is unique. 
Proof. Let A+ and A? both be linear derivatives of f at £ and put 
Ai—A2 = pw. Then, for i = 1, 2, 
fE+n) = f=Minl ee ee 
and therefore, by the triangle inequality, 


|, th 
ty 7° 38 Wal +0. (7.13) 


Now take any x ¢ R™. Since A! and A? are linear, so is ~ and, by 


(7.13), lel _ 9, 


|| = [> lim [ox 


Thus A? = a2. | 
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We now add a number of comments on the definition of differenti- 
ability. 
(a) It is sometimes convenient to write (7.12) in the form 


IfE+W—f)—AM)| = ofA) as [Al +0. 
(6) A linear function A: R' > R” is such that 
A(x) = ax (xe R) 


for some vector a; and there is a bijection between the A’s and the 
a’s. If f = (f,, ..-.f,)” is a differentiable function from R! to R”, this 
bijection provides the connexion between the linear derivative Df(£) 
of f at and the derivative f’(£) = (f%(), ...,f,(§))"; for Df(é) is the 


linear function on R' to R” determined by 
Df(E)(x) = f'(E)X = (Fi) %s +s fn(E) 2X)" (x € R). 


We shall see later (theorem 7.13) that, when f= (fj, ...,f,)" is a 
differentiable function from R” to R”, there is a corresponding 
connexion between Df(£) and the partial derivatives of f,, ...,f,, at &. 

(c) We have stressed that, when f: X > R” (where X < R”) is 
differentiable at £, then Df(£) is a linear function on R”™ to R”. On 
the other hand Df is a function from R” to L(R™, R"), the space of 
linear functions on R” to R” (see §3.2). The domain of Df is the 
subset of X on which fis differentiable. 

(d) If the function f: R” + R” is constant, then clearly for every 
EeR™, Df(é) is the zero linear function ©:R™ +R” (defined by 
@(x) = @ for all x € R”). 

(e) Let f: R” > R” be a linear function. The identity 


SE+N—-fE)—-S) = 9 


shows that, at every point of R”, fis differentiable and D/(£) =f. 
Note that this is an entirely different relation from 


(d/dx) exp x = expx (xe R) 


which is described by the equation g’ = g. 

(f) Terms other than linear derivative which are used for Df(£) 
are derivative (or total derivative) and differential, but these suffer 
from the disadvantage of having other well established meanings. 

(g) The relation (7.12) can be used to define the property of 
differentiability and the linear derivative of a function whose domain 
and range lie in arbitrary normed vector spaces. 
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It is easy to prove that differentiability implies continuity and the 
existence of partial derivatives. 


Theorem 7.12. If X < Rand the function f:X > R" is differentiable 
at the (interior) point & of X, then f is continuous at &. 


Proof. Denote the norm of the linear function Df(£) by k (see 
ao |DAB| < kl 
for all x ¢ R”. By the definition of differentiability, there is a 3 > 0 


amie E+) DLO < [rl 
when ||A|| < 6. Hence 


|FE+H-/O)I < |DFOMI|+ Al < &+ DIAl 
for || < 6. | 


Theorem 7.13. Let the function f = (fy, ++>fn)™:X > R" (X ¢ R™) 
be differentiable at the point £ of X. Then all the partial derivatives 
D.fé) @ = 1, «..,m3j = 1,...,) exist and the linear derivative 
Df) is given by 
D,fi(&).- Dm fl) \ [%1 
PEN RES 9 Needy (aa ao >) (= (&%, «+ Xp)" | R™). 
Di fnl§)-+-DinFalS)} \X mi 
Proof. The linear function Df(£):R"— R” is determined (see 
p. 40) by an equation of the form 


Oyy-octlig\, [Xe 
Df(£)(x) = ( Satake ( i (% = (%4y s015 Xp? © R). 


Anr++-Anm, Xm, 
Now |fE+A) —f( — DFE) M||/||h| + 0 
as ||h|| +0. Considering the jth component in the numerator and 
taking h = te’, we have 
| FE + te*) —f,() —ayit\/|t| > 0 
as t > 0. Thus D, f,(£) exists and is equal to a;;. | 
Note. If m = 1, i.e. if f = (fi, ..-,f,)” is a function from R? to R”, 


the matrix of Df(€) is the column matrix (/4(&), ...,/n())” which has 
previously been defined as /’(£). 
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Ifn = 1, ie. if fis a function from R™ to R}, the matrix of Df(é) 
is the row matrix (D, f(£), .... Dn f())- 
When m = 2, the determinant 


Dy fié).+- Dn Al) 


Dy frl8)-+-Dn fr) 


associated with the linear derivative Df(£) is called the Jacobian of f 
at € and is denoted by Jf(£). The classical notation is 


O(fis +++» fn) 


(Eas +05 Sn)” 


The fact that the linear function Df(£):R" > R” is bijective if and 
only if Jf(€) + 0 (see p. 40) is crucial for the implicit function 
theorem (7.43) and related results. The geometrical significance of the 
Jacobian is that it measures local magnification: if f is a function 
from R” to R” and E is a set none of whose points is far from &, 
then the volume of /(£) is approximately |Jf(£)| times the volume 
of £. This statement and the ideas it involves will be made precise 
in § 8.6. 

We have previously given an example of a discontinuous function 
whose partial derivatives exist. The converse of theorem 7.13 is 
therefore false. Differentiability, however, is ensured if the partial 
derivatives not only exist, but are also continuous. 


Lemma. The function f = (fy, ...5f,)":X — R” (X < R”) is differ- 
entiable at the (interior) point & if and only if each component function 
Sy: X ~ R° is differentiable at &. 


Proof. Let A be the linear function on R™ to R” determined by the 
matrix 


and let A; (j = 1, ..., 2) be the linear function on R” to R! given by 
the row matrix 
(Gjry «++ jm) 

To prove the lemma we need only remark that 


IFE+h)-/E)—AM|| = (lA) as [Al] +0 
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if and only if, for 7 = 1, ..., 1, 


|fE+N—-fO—-AWM| = ofA) as hl +0. | 


Theorem 7.14. Let X be a subset of R” and let & be an interior point 
of X. If the function f = (fy, «+15 fy)": X > R” is such that each partial 
derivative D;f; (i = 1,...,m;j = 1,...,m) exists in an open ball 
B(&; 6) and is continuous a £, then f is d ifferentiable at &. 


Proof. In view of the lemma it is sufficient to prove that each 
function f;: X + R'is differentiable at &. 
If A = (hy, «+5 Mm)”, let k° = 0 and 


kt = (hy, .2, hy, 0, ...,0)7 = hett+...+het (@ =1,...,m), 
sothat f,(§+h)—f,(€) = = {FE+k) -—f(E+ kh. (7.14) 


For each i, ki—k' = h,e* and so, by the mean value theorem, there 
is a number «; between 0 and 1 such that 

SEK) FEtkKY) = hD f(Etk1+a;he). (7.15) 
Since the functions D;f; are continuous at £ and 
‘ |KiA+ahcell] < [A] < [Al 
it follows that 

AD f(Erk*+a;hye) = h{D,f() +o} = hy Di f() + o(||All) 

as ||h|| > 0. Hence, by (7.14) and (7.15), 


HEHH-LO— Eh DHO = oll) | 


Exercises 7(a) 
1. Let X bea subset of R” and let £ be an interior point of X. Show that, if the 
function f = (f, ..-,f,)": X ~R" is such that all partial derivatives D; f, exist 
and are bounded in an open ball B(é; 6), then fis continuous at &. 


2. Let & be an interior point of the subset X of R”. Show that, if the function 
f: X + R' possesses the directional derivative D, f(g), then D_, f(€) exists and 
is equal to — D,f(£). 


3. The function f: ¥ > R'(¥ < R”) is differentiable at the (interior) point 
£ of X. Prove that every directional derivative D, f(&) exists and that 


D.f(6) = Df()(u). 
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4. If the function f: ¥ > R'(X < R”) is differentiable at the interior point & of 
X, the gradient Vf(é) of f at & is defined as the matrix of Df(é), i.e. 


VfE) = (Dif), «1-5 Din f(S))- 
Show that, if V/(é) + (0, ..., 0), then 


ee (vf)? 
TSO 
is the unique vector such that ||| = 1 and 


|Df®| = sup | Dus) = |D.,f@)|- 
5. The function f: R* > R' is given by 
2) when (x, )? + (0, 0)”, 
f(xy) = +? : oes 
0 when (x, y)? = (0, 0)7. 


Prove that at (0, 0)7 f is continuous and possesses all directional derivatives, but 
is not differentiable. 


6. The function f/: R? + R'is defined by f(x, y) = |xy| (Cx, »)” € R’). Prove that 
Sis differentiable at 0 = (0, 0)", but that there is no disc B(; 4) at all points of 
which D,fand D,/ exist. 


7. Thefunctionsd = (91, ..., dx)” andy = (yh, ..., Y»)" havea common domain 
X ¢ R™ and ranges in R", R” respectively. The function f; X > R"+” is defined 


si! LX) = ($100), «5 $n), VG), 4 WoO)" Cre X) 


and we abbreviate the right-hand side to (4(x), y(x))". Prove that fis differenti- 
able at the point £ e X if and only if 4, y are differentiable at € and that, when 
there is differentiability, D/(€) is given by 


Df(S)(h) = (DE(E)(h), DE)? (he R”). 


8. The real functions 4, / on R' are differentiable at the points a, b respectively. 
Prove that the function f: R® + R' given by f(x, y) = (x) YQ) (@, y)7 € R*) is 
differentiable at (a, 6)”. 


9. Find a function f: R? + R' which is everywhere continuous and nowhere 
differentiable. 


10. The function f: R* -> R° is defined by 
S(x,y) = (sin x cos y, sin x sin y, cos x)? (x, y)? € R®). 
Show that fis everywhere differentiable and that, for all (x, y)7 € R’, 
|DfG,y)|| = 1. 


7.2. Operations on differentiable functions 


Given two functions f, g from R” to R”, we may form their sum 
f+g (a function from R”™ to. R") and their inner product f.g (a 
function from R” to R'). We also consider scalar multiplication of a 
function from R” to R” by a function from R” to Ri. 


7.2] OPERATIONS ON DIFFERENTIABLE FUNCTIONS 205 
Theorem 7.21. 

(i) Suppose that the functions f: X > R" and g:X > R" (X < 'R™) 

are differentiable at &. Then f+g and f.g are differentiable at & and 
D(f+g)(6) = Df(é)+ Dé), 
D(f.g)(&) = f(8). Da(S) +8(&). Df). 

(ii) If the functions ¢:X > R' and f:X > R" (X < R”) are 
differentiable at &, then $f is differentiable at & and the linear function 
D(¢f)(&) from R™ to R" is given by 

DEMO) = HOIDAHOMN+(DEOCMSE) (xe R”). 


Proof. 
(i) The proof of the first statement may be left to the reader. To 
prove the second we write 


(F.8)(E+h)—(F.8)()-(F) [Da(6) A) + 8(6) LDA) MI} 
= (fE+M)—f() — DfE)(M}.g(E +h) 
+{g(E+h)—8(8)— De) )} SO) 
+[DAO)MI-{g(E+h)—s()} 
=Prqtt, 


say. By Cauchy’s inequality (theorem 2.21), |g| = o(||Al|) as |\Al| + 0. 
Using also the continuity of g at § we have |p| = o(|\h||) and 


Ir| < | DAE)I |All |gE+%—-gs|] = o(lA\). 


(ii) The proof is similar to the one we have just given. | 


We now turn to the composition of two differentiable functions. 


Theorem 7.22, Let X, Y be subsets of R™ and R" respectively. If the 
function f = (fis «+» fn)": X > Y is differentiable at the point § and 
& = (1, -++» Sp)": ¥ > R? is differentiable at the point f() = 4, then 
the composite function go f:X > R® is differentiable at § and 


D(gof)(£) = Dg(n)o Df(é), 


so that the matrix of D(gof)(&) is equal to the matrix product 


(ss aon (< ws “ro 


Dy8(1)-+-Dn& eM)! \Difulb)-+-Dinfrl) 
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Proof. Put Df(é) = A, Dg(n) = #, so that, if 
S(E+h)—f(E)— AA) = gh) 


and a(n +k)—g(y)—H(k) = r(k), 
then \|g(h)|| = o(||Al)) and ||r(k)|| = o(( All). 
Let (gof)(E+h)—(gof)()—(wo A)(A) = s(h). 


We have to show that ||s(4)|| = 0((|All). 
Since y is linear, 


s(h) = g(f(E+h) -a(fE) - HE +) -f(8) 
+H(S(E +h) -f()-AM) 
= r(f(E+h)—f(8) + ugh). 
We saw in the proof of theorem 7.12 that, when ||/|| is small, 
IFE+H—-SO| < (Al +D [Al 
Since also ||r(k)|| = o(||A\|) and ||r(@)|| = 0, it follows that, given 


e>0, 
IrfE+h)—-fO)| < elE+A)—FE)I| < eal +1 |All (7.21) 
for all sufficiently small ||/\|. Thus 
Ir(fE+h) -f()|| = o(lAll). 
(Notice that in (7.21) we cannot write 
IrFE+H—£E)|| = olFE+A)-F)), 
since ||/(E +h) —f(6)|| may be 0.) Moreover 
IeCa))\| < [eel lal) = o((|Al))- 


This proves that ||s(h)|| = o((|All). 

The last clause of the theorem now follows from the fact that the 
matrix of the composition of two linear functions is the product of 
their matrices. | 


Corollary. Let X be a subset of R" and suppose that the function 
S:X + R" is injective, If f is differentiable at the point & of X and f+ 
is differentiable at the point » = f(&), then Df(£):.R" - R° is bijective 


dis Df) = (DAO, 
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so that, if fz‘ denotes the i-th component of f+, 


Di f21).+-Dnf “a (- os ve) 


Dy fn (1) Dn Fn (0) Dy fi(§)---Dnfnl8) 


Using the functions f and g of theorem 7.22 put 


of = $= (pry op Pp)" 
Then the (j, /)th element D,¢,(&) in the matrix of Dd(£) is given by 


DG = E Dus) Dif (7.22) 


The formula (7.22) is the chain rule, Now denote points in R™ and 
R” by (X, «.+y Xm)” and (j4, ..-» Yn)” respectively. Then the classical 
form for (7.22) is aby _ & Oy Oe 

Ox; n= OV, Ox,” 


where éy,/0x; and 0¢,/8x;, are evaluated at and é@g;/@y;,, is evaluated 
at 7. The chain rule was given in this form in Cl (158). Theorem 
7.22 expresses the rule concisely and explains its origin. 

Note. When m = 1, so that f and ¢ = go/ are vector valued 
functions on R}, then 


( eel (‘9 
40)  \Dye,(0)..-Dag,0d! \FE) 
i $'® = Dgvn)(F'@)- 


When m = n = 1, so that fis a real function, and g is a vector 
valued function on R}, then 


$1(6) gi (7) gin) f'(E) 
alate eee ae) = 1 , 
(8) (1) g(MF"(E), 


Le. $'(E) = f'@)g'(FE)). 


If also p = 1, we have the formula, proved in C1 (68), for differenti- 
ating the composition of two real functions. 
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Exercises 7(5) 
1. Given the function f: ¥ + R" (X < R”), the function || f|| ; X > R’ is defined 


bi Ifa) = [7] eR. 


Prove that, if fis differentiable at the point £ € X, then so is ||/||, provided that 
|f@| + 0. 


2. Show that, if the function /: ¥ > R" (X © R”) is differentiable at the point 
£eX, then so is the function ||/||?: ¥ > R%. Prove also that, if f is such that 


\|f|| is constant, then SE). Df (x) = 0 
for all xe R”. 


3. Let X be a subset of R" such that tx e X whenever x € X and ¢ > 0. The 
function g: X > R? is said to be homogeneous of degree « (where @ is real) if 


a(tx) = t7g(x) 
for all xe X and ¢ > 0. 
Let X be open and let g be differentiable at all points of X. 
(i) Show that, if g is homogeneous of degree a, then each function D,g 
= (D;g,, ..., Dig)” : X > R” is homogeneous of degree «—1. 
(ii) Prove that a necessary and sufficient condition for g to be homogeneous 


of degree « is that HELENE SCHED 


for all xe X. 
4. The function /: R*— {6} > R? is given by 
(x, y)* 
x,y) = 
FOOD" Ten 


(« real). Use the polar transformation p : R® > R? defined by 
@ Y* = ptr, ¢) = (rcos J, rsin $)” ((r, 4)” € R*) 
to prove that Jf(x, y) = (1-2) ||(x, »)|| =*. 
5, The function f = (/,, fa, fs)" : R? > R® is given by 
Six) = %1— 1%, fox) = XyX2—X1%0%s, fa(x) = X1%0%s. 


Prove that f is injective in X = R°—{x|x,x, = 0} and find Y = f(X). Show also 
that f+: Y > R* is differentiable and evaluate J/-(y) for all ye Y. 


7.3. Some properties of differentiable functions 
In the study of real functions the mean value theorem is a powerful 


tool. Its analogue FO)= fu) = DA e=u) 


(for suitable £) holds for functions f from R” to R! (see exercise 7(c), 1). 
The corresponding result for vector valued functions is false (see 
exercise 7(c), 2), but the theorem below is a partial substitute. In it 
we use the notion of convexity. A set S in R” is convex if, whenever 


7.3) PROPERTIES OF DIFFERENTIABLE FUNCTIONS 209 


two points belong to S, then so does the segment joining them. An 
interval, an open ball, or a line segment provide examples of convex 
sets. 


Theorem 7.31. Let X be a subset of R™ and let S be a convex subset 
of X. If the function f: X > R" is differentiable at all points of S and 
|| D/(x)|| is bounded for x € S, then, for all u, v €'S, 


If@)—FO) < (sup | BFC) lu— el. (7.31) 
Proof. Take any points wv, v in S and put v—u = A. If f(u) = f(r), 
(7.31) clearly holds. Otherwise let w be the unit vector in R” such that 
fe) -F@)| = oF) -F@}- (7.32) 
Now define the function ¢:[0, 1] > R' by the relation 
P(t) = w.f(ut th). 


Then ¢(0) = o.f(w), (1) = .f(v) and ¢ is clearly continuous on 
[0, 1]. Also ¢ is differentiable in (0,1) and (see note following 


theorem 7.22) $'() = 0. Dfutth)(h). 
By the mean value theorem, there is a 7 in (0, 1) such that 
$(1)— 90) = 9'@); 
aes of f(v)—f(w} = o. Df(u+th)(h). 
Then, by (7.32), 
|f@)—f@)|| = ©. Df(u+rth)(h) < || Df(utrh)| |All 
and, since u+7h € S, this implies (7.31). | 


Under certain conditions there may also be a lower estimate for 
\|£(@) —f(v)||. We need only a simple result of this kind. 


Theorem 7.32. Let X be a subset of R" and let the function f: X > R” 
be differentiable at the point &. If Jf(&) + 0, then there isa é > 0 such 
that 
1 
IFE+M SOI > apaHay Ill (7.33) 
DOA 


whenever ||h\| < 6. 


Proof. We have 
S(E+N-fE) = DIHNM+rO); 
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where |\7(/)||/||A|| + 0 as ||h|| +0. Then 


|FE+A)—f|| = |DAOM| - |r| 
1 
2 Toney" —|r@|, 
Al, = |DAOADLHN M3) < | DAO >| |DADMI|s 


and we choose 6 so that 
1 
|r|. < I DFo>| |All 
for ||Al| < 6. | 


An immediate consequence of the mean value theorem is the fact 
that a real function whose derivative is zero in an interval is constant 
in that interval. Theorem 7.31 enables us to prove a similar theorem 
for functions from R” to R”. 


Theorem 7.33. Suppose that the set G in R” is open and connected. 
If the differentiable function f:G — R" is such that, for every £€G, 
Df(&) is the zero linear function © (see p. 200), then f is a constant 
Junction. 


Proof. Let u be a fixed point of G and let x be any other point of G. 
By theorem 3.32, u and x may be connected by a polygonal are 
lying entirely in G, Denote the vertices of this arc by 


Ua Xs eee ke 


Since the straight line segment joining x‘! to x‘ is a convex subset of 
G, it follows from theorem 7.31 that f(x‘) = f(x‘). This holds for 
i= 1,...,p and therefore f(x) = f(u). | 


In the theorems of the next section (and in others) the functions 
under consideration will not only have to be differentiable; their 
linear derivatives will also be required to be continuous. The sense 
in which continuity is to be understood is entirely natural. Let the 
function f: X > R" (X < R”) be differentiable in the subset X, of X. 
If €€ X,, Df(é) is a linear function on R” to R", ie. Df(é)e 
L(R™, R”); and, as we have previously remarked, the linear derivative 
Df is a function with domain X, and range in L (R”, R"). The set X, 
is equipped with the metric induced by R™ and the set L (R™, R") 
has a natural norm (see (3.22), p. 41) which produces a metric. 
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Therefore the usual notion of continuity applies to the functions on 
X, to L (R”, R"), of which Df is one. If all points of X are interior 
points, i.e. if X is open, then X; may coincide with X and we are led 
to the following definition. 


Definition. A function f:G -> R", where G is an open subset of R™, 
is said to be continuously differentiable if Df(£) exists for all £€G 
and if the function Df:G > L (R™, R") is continuous on G. 


Let (X, p) be an arbitrary metric space. A function 
AX > L(R”, R") 
may be represented by a matrix 


Cais oom 


each element a,; of which is a function on X to R’. The inequalities 
(theorem 3.25) 


mex laj(x) —a;(8)| < |AG)—-AE)| < & laje(x) —;,(6)2)* 


show that A is continuous at the point & € X if and only if each of the 
functions a;; is continuous at £. Combining this result with theorems 
7.13 and 7.14 we obtain a simple criterion for a function to be con- 
tinuously differentiable. 


Theorem 7.34. Let G be an open subset of R™. The function 
S = (fis os fn)? iG > R” 


is continuously differentiable if and only if each of the partial derivatives 
D; f;(i = 1, ...,m3j = 1, ..., m) exists and is continuous on G. 


It is evident from the definition of continuous differentiability (or 
from theorem 7.34) that, for real functions, the property is equivalent 
to the possession of a continuous derivative. 


Exercises 7(c) 
1. Let X be a subset of R™ which contains the points u, v and the segment 
o = {x|x = ut+t(v—u);0 <t < 1}. 


The function f: X > R is continuous at u, v and differentiable at all points of o. 
Show that there is a point £ of 7 such that 


fO-fU) = D/O (eu). 
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2. The function f: R! > R? is given by 
f(x) = (cos x, sin x)". 
Prove that there are points u, v € R! such that 
Se) -SU) + DfE)\e-w) 
for all e RY. 
3. Prove that, under the conditions of theorem 7.31, 
|S@)-f(@)- Df (v-u)| < (sup | D#G)— Df@)||)||o-u\) 
x 
for all u,ve S. 
4, The set G in R” is open and the function /: G + R" is continuously differ- 
entiable. Show that, if K is a compact subset of G, then 
i) |f@+H-SG)| + 0, 
(ii) | Fe+h)—f0) — Df) ()||/||h|| + 0 


as || > 0, uniformly for x € K. 


5. Let G be an open, connected subset of R” and let (f”) be a sequence of con- 
tinuously differentiable functions on G to R". Suppose that (/”(x)) converges for 
at least one x € G and that (Df”) converges uniformly on every compact subset 
of G. Show that 

(i) (f”) converges uniformly on every compact subset of G; 

(ii) f = lim f” is continuously differentiable in G and, for all x € G, 


Df(x) = lim Df*(x). 


7.4. The implicit function theorem 

As an application of Banach’s fixed point principle we obtained 
in chapter 3 a theorem on the existence of implicitly defined functions. 
We begin by proving a variant of that theorem in which the hypo- 
thesis is a little more stringent and the conclusion is correspondingly 
strengthened. 


Theorem 7.41. Let (&, 9)" be an interior point of a set E in R® and 
suppose that the function f: E > R° satisfies the following conditions: 


(i) SE, ) = 05 


(ii) fis continuously differentiable in an open set G containing (£, 9)" ; 
(iii) Daf(E, 9) + 0. 
Then there exist a rectangle 
MxN = [§-«, +a] x[7-£, 7+] 
and a continuous function ¢:M — N such that y = ¢(x) is the only 
solution lying in Mx N of the equation f(x, y) = 0; moreover ¢ is 
continuously differentiable in M° (the interior of M) and 
$(x) = — Dif (x, @))/ Def, (>) 


for E-a<x< +a, 
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Proof. Theorem 3.47 gives a unique solution ¢, but only guarantees 
its continuity. To prove continuous differentiability we first remark 
that M and N may be taken so small that Mx N ¢ G and, for 
(x, y)? €Mx N, Dof(x, y) + 0. Next, take a point x in the open 
interval (€—c, +c) and let A be any non-zero number such that 
x+the[E&—a, +a]. Then 


(fxth, $x+h)) fe, $+ My} + (FO, ox+H)) —f(x, d))} = 0 
and so, by the mean value theorem, 
AD flu, $(x+h)) + {e+ A) — $x} Da f(x, v) = 0, 


where u lies between x and x+h, while v lies between (x) and 
o(x+h). Thus, since D, f(x, v) + 0, 


d(xt+h)—G(x) __ _ Di flu, (x +h) 
h Da f(x,v) * 


It now follows from the continuity of the functions ¢, D,fand Df 
that, first, 4’(x) exists and is equal to 


— Di f(x, $2) Dif OO) 


and, secondly, that ¢’ is continuous on (§—@, §+<). | 


A simple example will serve to emphasize the Jocal character of 
the solution of the equation considered in theorem 7.41. If fis given 
us f(x, y) = x+sin y, 
then in the rectangle [—1, 1] x [—47, 47] there is a unique solution 
passing through the point (0, 0)”. There is no solution through any 
point (x, y)” with |x| > 1; and, if > 47, solutions in 


[-1, 1 x[-£, A] 


are not unique, i.e. there are values of x in [—1, 1] to which there 
correspond two or more values of y in [—A, f] such that f(x, y) = 0. 

The problem of theorem 7.41 has an obvious generalization in 
keeping with the spirit of the present chapter. In the equation 
S(x,y) = 0 we replace the real numbers x, y by points in R" and R” 
respectively. The function f will then have its domain in R™ x R” and 
it is easy to see that the range of f should be in R”. For, writing 
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X= (Xp sory Xm)?s Y= (Yrs vey Vn)” and f = (fy --1fn)” we then 
have the system of equations 


SiG» +03 Xs Vis «+2 Vn) = 0, 
He Ryecsremieya eindiesaaeraaaagentnes (7.41) 


Fn(Xrs +++9 Xmp Var +019 Vn) = O 


which is to lead to unique expressions for )y,...,¥, in terms of 
Xy, +++) Xm; and our experience shows that the number of equations 
should, in fact, be equal to the number of unknowns. 

The equations (7.41) suggest that the domain of fis in R"*", On 
the other hand the vector equation 


I(x, y) = 8 


indicates a domain in R” x R”, as was originally stipulated. This dual 
notation is legitimate in view of the natural identification of points 
in R™ x R" and R™™, By equipping R” x R” with the norm induced 
by R”*" we make the two spaces entirely interchangeable; and we 
shall use either or both as convenient. For instance we denote by 


Dif Qiy ores Xs Vv v5 Pn) 


the partial derivative of f; with respect to the ith co-ordinate in R™*™ 
(an x if 1 <i<m,ay if m+1 <i < m+n) and we also use the 
abbreviation D; f(x, y). 

The indicated generalization of theorem 7.41 can be formulated 
and proved with the use only of partial derivatives, but it is more 
illuminating to use also a concept of partial differentiation which is 
akin to linear differentiation. 


Definition. Let f be a function from R™ x R" to R? and suppose that 
(&, 9)? (§ €.R”, 7 € R") is an interior point of the domain E of f. If 
there is a linear function X: R" > R® such that 


[FE+h, 1) FE, 1) - A) = o(|h||) as lhl] +0, (7.42) 


then A is the linear partial derivative Da) /(, 4) of f at (&, 9)". The 
linear partial derivative Di) f(é, 4), a linear function on R” to R®, is 
similarly defined. 

The argument of theorem 7.11 shows that linear partial derivatives 
are unique. 


Theorem 7.42, Suppose that the function f:E > R? (E < R™x R") is 
differentiable at the point (&, 4)". Then Da) f(& 1) and Do f(&, 1) 
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exist; moreover, for all x € R™ and all y € R", 


Da fE ) = DFE NO 4) 
and Do fE NO) = DE, 1G, ¥). 
Proof. By the definition of Df(é, 7), 


|P(E+h, 7 +k) SE 1) — DFE, nh, k)|| = o(|\(h, |) 


as ||(h, k)| +0. Hence, taking k = 0, we have (7.42) with A(h) 
replaced by Df(é, 7)(h, 9). The uniqueness of linear partial deriva- 
tives now gives the result for Da) f(&, 7). | 


Corollary, Under the conditions of the theorem 


[Dw SE | |Do AE | < | DAE I. 


If the function f = (f,, ...,f,)7 from R” x R” to R? possesses the 
linear partial derivative Dy /f(&, 7), then the partial derivatives 
D; f,(&, 9) @ = 1, ...,m;7 = 1,...,p) exist and Dw f(é, 7) is repre- 
sented by the matrix 


(": £1) ++» Dn fis, ‘ 


(7.43) 
Dy f(§, 0)-+- Din fn(Ss 0) 


This is proved in the same way as theorem 7.13. Similarly, 
when Dw f(&, 7) exists, then the partial derivatives D; f,(&, 7) 
(i =m+l1,...,.m+n;j = 1,...,p) exist and the matrix of Dg f(é, 7) 


e DmssSil&s 1)» Dmnanfil&e 1) 
( ; (7.44) 


Dmnsafo(bs 1)+--Dnrsn Sol 1) 


Thus, if fis differentiable at (&, 7)”, the matrices of Diy f(&, 7) and of 
De f(é, 7) consist, respectively, of the first m and last n columns of 
the matrix of Df(&, 7). 

When p = m, the matrix (7.43) of Da f(s, 7) 18 square and we 
denote its determinant by Jq) f(&, 7); when p = n, the determinant 
of (7.44) is denoted by Jig) f(&, 7). 

We have now laid the groundwork for the principal theorem of 
this chapter. 
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Theorem 7.43. (Implicit function theorem.) Let (£, 7)7( € R™, 7 = R") 
be an interior point of a set E in R™ x R" and suppose that the function 
S:E > R” satisfies the following conditions: 


(i) f(E, 1) = 9; 
(ii) f is continuously differentiable in an open set G containing 
(8, "5 
(iii) J f(E, 7) + 9. 
Then there exist intervals 


M = [&,-@, +0]... [Em—% Em +o], 
N = [n-2, n+Alx-.-xln-Ps nth) 


and a continuous function ¢:M + N such that y = ¢(x) is the only 
solution lying in Mx N of the equation f(x, y) = 9; moreover ¢ is 
continuously differentiable in M° and 

Dd(x) = —[Dw fx, O)I*0 Da S PO) (7.45) 
for x € M°. 

Proof. The proof follows the lines laid down in the proofs of 
theorems 3.47 and 7.41, except for additional complications which 
arise from the absence of a mean value theorem. 

By (ii), the function Jig) f is continuous on G. Hence, by (iii), we 
may suppose that, for (x, y)” € G, J f(x, y) + 0, so that the linear 
function De f(x, y): R" > R" is bijective. Put De f(é, 7) = Q. 

Since the function Df is continuous on G, there are intervals 


K = [&,-6, £40]... x [En—8 Em +4), 
N = [n—-A, m+A)x-.*lm—-B nA) 
such that, for (x, y)7 € Kx N, 
| DFE, ») — Df, y)|| < 1/n4|O~|)). 


Then, denoting by J the identity function on R” and using the 
existence and linearity of Q-!, we have 


|1-Q0 Dy f(x, »)|| = |O*° (Da fE, ) — Da S% ¥)}| 
< |O7| |Da SE 1) - DoS ¥)I| 
< ||Q>| | DAE, 1) — Df, »)I| 
< 1/(2n}). (7.46) 
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By (i) and (ii) we can also find a positive number a < ¢ such that, 
for xe M = [£,—«, £, +a] x... x[En—&, Sm +, 


[fe nll < 2/227) 
and therefore OL, lll < 42. (7.47) 


Denote, as usual, by B(M, N) the set of all (bounded) functions 
y:M - N, and by C(M, N) the set consisting of all the continuous 
functions in B(M, N). By theorems 3.44 and 3.45, the two spaces, 
equipped with their customary metrics, are both complete. 

Let © be the mapping on B(M, N) defined by 2(j/) = x, where 


x) = ¥(xX)- O71 YO) eM), 


Note that, if y is continuous on M, then so is x. 
We first show that 2 maps B(M, N) into itself. Let y € B(M, N). 
Then, for xe M, 


QIW*E)—1 = ¥O)- O71, YONI-7 
= YO) - 27 YO} -f- 27 MI - 7G; mI. 
Now, for fixed x, the function 
I—Qof(x, .):N > R® 


(where f(x, .) is the function g:N > R” defined by g(y) = T(x, y) 
for y € N) has at y the linear derivative 


I-Q~0 Da f(x, ¥); 


for, at any point, the linear derivative of a linear function is the 
function itself. Hence, by theorem 7.31 and by (7.46) and (7.47), 


|2Q)@)—al < ylve)— a] +48 < B. 


We next use a similar argument to prove that is a contraction 
mapping. If ¥, %% € B(M, N) and xe M, 


2G) x) — 2G) @) 
= hQ)- 27% nO)}- YW) - O77; vaCN 
and so, by theorem 7.31 and (7.46), 
|2G@)-2G)0)] < EnC)-2)]. 
Thus PQW), LY) < 4eG, Wo). 
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Tt now follows from theorem 3.46 that Q has a unique fixed point. 
In other words there is a unique function ¢:M—WN such that 
Q() = ¢, ie. f(x, A(x)) = 6 for xeM. (The uniqueness of ¢ 
implies, in particular, that 6(£) = 7.) 

To prove that ¢ is continuously differentiable we proceed in stages. 
First we note that ¢ is continuous. For we have remarked that, if 
is continuous, then so is Q(y/). Hence, if Q* is the restriction of Q to 
C(M, N), then Q* is a contraction mapping on C(M, N). Therefore 
Q* has a fixed point and, since a fixed point of * is also a fixed 
point of Q, it follows that ¢ is the fixed point of Q*. Thus ¢ € C(M, N). 

The next step is to show that, for x € M°, 


Ig@+h)-4¢@)| = O(Al) as [Al] +0. 


Put Dw f(x, (x)) = S. Since S is bijective and ¢ is continuous, it 
follows from theorem 7.32 that, when ||/|| is sufficiently small, 


[Fes A +A)I| = fo, d+) -F0 4O))]| 
1 
? Fs3] |d@+A)—@)]. 
Also, since Df is continuous on Mx N, for (u, v)” € Mx N, 
|Dnfu, OI) < |BAw, oI) < A, 
say. Hence, by theorem 7.31, 


[fe de +M)l| = FOr+h, Pe +h)—Ser, do +h)|| < AlAll. 


Therefore, when ||A\| is small enough, 


psy +H) - AC] < 17% H+] < Al 
or Jor+)— 9] < BI. 


We can now prove that D¢(x) exists and is given by (7.45). Putting 
(x) = y we have 


Sx+h, y+k)—f(x, y)— Df(x, y)(h, k) = rh, k), 


Ir, | 
(A, k)) 


Now take k = ¢(x+h)—¢(x) so that f(x, y) = f(x+h, y+k) = 0. 
Then Df(x, y)(h, k) = —r(h,&), 


where >0 as |\(h, k)|| +0. 
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i.e., by theorem 7.42, 
Da f(x, y)(h) + Da f(x, y)(K) = —rh, k), 
and so 
{DoS v0 Daf, WA) +k = —Dw Se YI, ). 
Thus 
$(x+h)—$(x) + [Deo fx, 9) 0 Day fe, $()} (A) = RA), 


where | RG) < |SA|r@, ¢@+A)— 409)| 
[Al [Al 
< |S rh, be+h)— $29) [Al] + BAM] 
1G, d&+h)-¢@))| [Al 

IIr(h, G(x +h)—$(2)| 
= Cle : 7.48 

I, 6+) —9))| ia 
say. Since ||¢(x+h)—¢(x)|| +0 as ||Al| +0, the right-hand side of 
(7.48) tends to 0 as ||A|| + 0. 

Finally we show that D¢ is continuous or, equivalently, that the 
partial derivatives of ¢,,...,¢, are continuous. This follows from 
the continuity of ¢ and from the matrix equivalent of (7.45) which 
gives each D;¢,(x) as a rational expression in the partial derivatives 
of fat the point (x, ¢(x))”. | 


Notes. 
(i) The formula (7.45) agrees with the result obtained on differ- 
entiating the equation 


I(x, OX) = 9 (xe M°) 


when ¢ is known to be differentiable. In the case m = n = | the 
chain rule immediately leads to the identity 


Di f(x, $(2)) + Daf (x, 42) $C) = 0 
(cf. theorem 7.41). In general define the function g: M° > R™ x R” by 
a(x) = (x, d(x)". 
Then (see exercise 7(a), 7) Dg(x) is given by 
Dg(x)(h) = (h, Do(x)(h))*. 
Hence, putting g(x) = z we have, by theorems 7.22 and 7.42, 
6 = D(fog)(x)(h) = [Df(2)o Da(x)](h) = Dflz)[Dg(x)(A)] 
= Df{(h, DOM) = Da fA) + Do f@ (DO) A). 
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Thus Dea f(x, 60) ° DA(x) = — Day f(x, $(x)). 
(ii) If, in the theorem, m = 7, so that the matrices of Da f(x, y), 
De f(x, y) and D¢(x) all have n rows and n columns, then 
nJoS%, 9) 
JER) = (— IP 5 Ales, $0)" 
(For if A is an xn matrix, then det (— A) = (—1)" det A.) 
(iii) The condition Ja) f(g, 7) + 0 is not necessary to ensure the 
existence, in the neighbourhood of the point (&, 7)", of a unique 
solution y = ¢(x) of the equation f(x,y) = 9. For instance the 


equation f(x,y) = 8-y2 =0 (ye R) 


has the unique solution y = x, but J f(0, 0) = 0. 


Mlustration. Here, as so often in particular examples, we discard the suffix 
notation for vectors and use x, y, u, etc. as co-ordinates. 
The equations 
A(x, Y, Uy v, W) = x(ut+v)+yw—3 = 0, 
SAX, Y, Uy V, W) = x(UP+ 0%) +yw?—5 = 0, (7.49) 
Falx, Y, Uy v, W) = x(u8 +03) +yw8—9 = 0 
are satisfied at the point (1, 1, 0, 1, 2)7. 
If p = (x, »)",q = (u,v, w)? and f= (ff, fs)7, the equations (7.49) may 
be written 
f(2,q = 9. 
Then 
x x 9 


Jaf(p,Q =| 2xu  2xv 2yw | = 6x*y(v—w)(w—u)(u—v) 
3xu® 3xv? 3yw* 
and so, if po = (1, 1)7,¢0 = (, 1, 2)7, 
Jof(Pos Jo) = 12. 
Therefore there is a solution g = ¢(p), i.e. 
u= (x,y), v= dlx,y) w= dalx, y) 


which passes through the point (po, qo)” or (1, 1, 0, 1, 2)”, and the solution is 
unique in the neighbourhood of this point. 
The matrices of Diy f(p, q) and Dw f(p, q) are 


utv ow is mane y 
ut+v? w*}, [2xu 2xv 2yw ], 
ue+v> wy 3xu® 3xv? 3yw? 


respectively. Therefore, by (7.45), the matrix of — Dd(pp) is 


1 ae Cems Ih Rea Do) 1 12 = 9) ZN i 5 4 
02 4 1 4 a 0 12-4]]1 4 D 8 16}. 
0” 312; 1 8 OS 2p aes, -1 4 
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Thus Didi, 1) =, Dida, 1) = 4 
Dib, 1) =-3, D,$,(1, 1) = —-4, 
D,ga(l, 1) = ts, Di$a(1, 1) = —4. 


Exercises 7(d) 


1. Let f be a function with domain E ¢ R” x R" and range in R” and let (£, 7)” 
be an interior point of E. 

(i) Show that both Dwf(é,7) and Dwf(é, 7) may exist without f being 
differentiable at (£, 7)7. 

(ii) Show that, if both linear partial derivatives of f exist in an open ball with 
centre (£, 7)” and Dy f, Df are continuous at (£, 7)”, then f is differentiable 
at (E, 9)”. 


2. Prove that, if (¢, 7)” satisfies the equation 
xy—logx+logy=0 (x,y > 0), 


then there is a continuously differentiable solution y = #(x) which passes 
through this point and is unique in its neighbourhood. Prove also that there is 
one point (é, 7)” such that the corresponding solution y = (x) has a maximum 
at £. 


3. The function f; R' > R* is continuously differentiable, f’ is strictly increasing 
and lim f’(x) = ~, lim f(x) = 0. Prove that, to any £ + 0, there corres- 
20 2-0 


Ponds an q such that f+) = fO+/@) 


and that through such a point (&, 7)” there passes a solution y = ¢(x) of the 
equation 
fxt+y) = f@)+f0) 


which is unique in the neighbourhood of (&, )7. 
Construct an example to show that, when & = 0, there may be no corres- 
ponding 7. 


4. Find a point (¢, 7, )7 in the neighbourhood of which the equation 
sin yz+sin zx+sin xy = 0 
has a unique solution z = ¢(x, y). 
5. Show that in the neighbourhood of any point which satisfies the equations 
x*+(x+z)y°—3 = 0, 

x4+(2x+3z)y3-6 = 0 
there is a unique solution y = ¢,(x), z = ¢,(x) of these equations. 
6. Show that the equations 


xy +yub+ zo = 1, 

xsy+yutz'v = 1 
have a unique solution u = ¢,(x, y, z), v = ¢» (x, y, z) in the neighbourhood of 
the point (9, 2,4, )F = 0,1, 1, 1, 0)7 


and find the matrix of D¢(, 1, 1) (where 4 = (1, ¢2)7). 
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7. Verify that there are points which satisfy the equations 


x*+ute’ = 0, 
y+ovter = 0, 
2+twtet = 0, 


Prove that, if (x9, ¥o, Zo, “os Vo, Wo)” is such a point, then in its neighbourhood 
there exists a unique solution u = ¢,(x, y, z), v = $2(x, y, z), Ww = $4(x, y, Z). 
Express the matrix of D(x, y,z) (where ¢ = (¢,, 4, ¢3)7) in terms of 
X,Y; Z, U,V, W, 
8. Show that there are points which satisfy the equations 

x—e“cos v = 0, 

v—evsin x = 0. 


Prove that, if (xp, 79, “o, Uo)” is such a point, then in its neighbourhood there 
exists a unique solution (u, v)? = (x, y). Show that 


I(x, y) = v/x. 


9. The functions f, g: R'— R are continuously differentiable and /’, g’ are 
strictly positive. Suppose that the equations 


f(xu)+ g(r) = 0, 
fOr) +e(zw) = 0, 
f(zw)+a(xu) = 0 


are satisfied at the point (x9, Vo, Zo, Uos Vos Wo)7, Where Xo, Yo, Zo + 0. Show that, 
in a neighbourhood of this point, there is a unique solution (w, v, w)7 = (x, », z) 
with Jacobian 

IG(x, ¥, 2) = ——. 


7.5. The inverse function theorem 


Let f be a function with domain and range in R". The question 
whether fhas an inverse can be put in the form: given y = ()4, ..., Yn)” 
in the range of f, does the vector equation 


S)-y = 9, 
ie, the system Sip «+5 Xn) -—Y1 = 0, 


Sn Q» ++ Xn)—In = 0, 


have a unique solution for the vector x = (x, ..., x,)” in terms of 
Y = (Vy «+s Yn)”? The problem of inversion is therefore little more 
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than part of the larger problem, solved in the previous section, of 
the existence of implicitly defined functions. 


Theorem 7.51. (Inverse function theorem.) Let & be an interior point 
of a set E in R" and suppose that the function f:E > R" satisfies the 
following conditions: 

(i) fis continuously differentiable in an open set containing g; 

(ii) Jf(E) + 0. 

Then there exists an open set U containing & such that the restriction 
of f to U is injective; the inverse function ¢ is continuously differentiable 
on the open set V = f(U); and if ye V and y = f(x), where x € U, 


a D¢(y) = [Dfedl*. (7.51) 
Proof. Define the function g: E x R" > R” by 
g(x,y) =f(@X)-y (xe Eye R"). 


Then g is continuously differentiable at a point (x, y)” as long as f is 
continuously differentiable at x. This follows from the continuity of 
the partial derivatives D,g, which are given by 

(DiC) if 1<i<n, 

Nes eemifa ribs: <27, 


where 6,, = 1 when r = sand 0 whenr + s. Hence, if f(é) = 7, then 
g(E, 9) = 0 and g is continuously differentiable in an open ball with 
centre (&, 7)”. Also clearly Dag(é, 7) = Df(é) and so 


Jag, 0) = Jf(E) + 0. 


We may therefore apply theorem 7.43 to g (with the roles of x and y 
interchanged). This means that there are intervals 


Dyg,(x, y) = 


M = [£,-«, &+0]x...x[En—% En +o], 
N = [m-8, mt Flx-.* DnB, Int A) 


and a continuous function ¢:N > M such that x = ¢(y) is the only 
solution lying in M x N of the equation f(x) = y. In other words, the 
restriction of f to ¢(N) (< M) is injective and the inverse function 
¢ is continuous. 

Since ¢ has a continuous inverse, by theorem 3.23, (N°) is open; 
and, since 7 € N°, £ = $(7) € (N°). Put U = ¢(N°), V = N°. Then 
V = f(U) and this set is open. 
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Finally, ¢ is continuously differentiable in N° and so in V and 
Dd(y) = —[Dws(¢Q), YI Dag(ZQ), ¥). 
Thus, if ¢(y) = x and / is the identity function on R", 
Dé$(y) = —[Df(@x)}*0(-1) = [DfEOI". | 
(The formula 7.51 also follows from theorem 7.22 once the exist- 
ence and differentiability of 6 have been established.) 
Corollary. Under the conditions of the theorem 
JO) = 1/JfQ). 
Illustration. The function f: R® > R? is given by 
F(x, Y) = (xe", xe)7. 


We have If(x, ¥) = 


ev 
ev— 


Hence theorem 7.51 guarantees the existence of a local inverse (x, y)™ = (wu, v), 
i.e. a unique solution of the equations 


xeY = u, xe" = v, (7.52) 
in the neighbourhood of any point (£, 7)” such that + 0. The matrix of 
BM: ee hae Vat hae wee (7.53) 

ev —xe] — 2x \e —ev)* " 


In fact it is easy to find ¢ explicitly. The range of f is the set {(w, v)7 |uv > 0} 
and the equations (7.52) lead to 
x = +(w), y = log (u/v)* 


when u, v + 0, ie. x + 0. If > 0, the local inverse is x = (wv)*, y = log (u/v)* 
and, if £ < 0, it is x = —(uv)', y = log (u/v)*. When & = 0, there is no inverse 
for then u = v = 0 and f maps any point (0, y)” into (0, 0)”. Finally we note 
that the matrix of Dd(u, v) is 

(* 4u-tot te 


Sa iy 
according as x = (uv)* or x = —(uv)t, and this is the same as (7.53). 


The one-dimensional form of the inverse function theorem is not 
new (see C1, 62 and 69) and may be extended to provide for a global 
instead of only a local inverse. For if a real function has a continuous, 
non-vanishing derivative in an interval, then the function is strictly 
monotonic and therefore injective. In higher dimensions there is no 
corresponding extension. If the Jacobian of a function f does not 
vanish on an open set, then f need not be injective on that set (as a 
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whole) even if the set is connected. For instance the function 
J: R? > R* given by 


A(x, y) = eZ cosy, f(x,y) = e* sin y 


is not injective, since all the points (x, y+2n7)7(n = 0, +1, +2, ...) 
have the same image; but Jf(x, y) = e% > 0 for all (x, y)” eR’. 
Nevertheless the next theorem shows that the non-vanishing of the 
Jacobian entails a property which had previously been known only 
for functions with continuous inverses. 


Theorem 7.52. Let E be a subset of R". Suppose that the function 
S:E > R” is continuously differentiable on the open set G < E and that 
Jf(x) + 0 for x € G. Then f(G) is open. 

Proof. Take any point 7 €f(G) and let £ € G be such that /(£) = 7. 
Then & is an interior point of G and, by theorem 7.51, there is an 
open set U in G which contains & and is such that V = f(U) is 
open. Since 7 € Vand V < (G), it follows that 7 is an interior point 


of f@). | 


Exercises 7(e) 


1. The function f from R" to R” is differentiable at the point €. Prove that the 
condition Jf(é) + 0 is not necessary to secure the existence of an inverse in the 
neighbourhood of the point £; but that it is necessary for ensuring the differ- 
entiability of this inverse. 


2. Show that the function f: R? > R® given by 
f(x,y) = (cosx+cosy, sin x+sin y)” 


has an inverse in the neighbourhood of all points (&, 7)” such that —9 + nv 
(n = 0, +1, +2, ...) and that at all other points no local inverse exists. 


3. Prove that, if £, 7, ¢ + 0, then the function f: R* > R* given by 
L(x, ¥, 2) = (yz, 2x, xy)? 


has an inverse ¢ in the neighbourhood of (, 7, ¢)7 and find the matrix of 
Dd(y2, zx, xy). 


4. Prove that the function f: R* > R® given by 


(ee ee | 
SO, ») = (a ree 


has an inverse in the neighbourhood of every point of R*. If ¢ is the local 
inverse at (x, y)", find JA(/(x, y)). 
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5. The function f = (fi, fi, fa)? : R® > R* is given by 

Aix, y, Z) = x+y¥4+z, 

Silx, y, Z) = yztzx+xy, 

Sal%, Ys Z) = XYZ; 


and &, 7, € are (pairwise) unequal real numbers. Show that / has an inverse ¢ 
in the neighbourhood of the point (£, 7, 6)? and that 


I$ (x, », 2) = -I0-2)G-HG-y). 
6. Show that the function f/: R" > R" (n > 3) given by 
Seay ooey Xn) = Np Xay Appa «vey MiNpee Apa pp Mae Anat Xn)” 
has an inverse ¢ in the neighbourhood of the point (1, 1, ..., 1)” and prove that 
IP(2, 2, ..., 2) = (—1)". 


7. Let G be an open subset of R" and suppose that the function f: G > R" is 
continuously differentiable and that Jf(x) + 0 for all x in G. Show that the 
image f(F) of a closed subset F of G need not be closed. 


7.6. Functional dependence 


The last theorem was stated as a result on mappings. It acquires 
a different aspect if its conclusion is replaced by the following (weaker) 
statement: a function VY from R” to R! for which ‘V(f(x)) = 0 when 
x € Gis such that ¥(y) = 0 in an open set. In this form the theorem 
is related to the notion of functional dependence. 


Definition. The real-valued functions f,, ...,f, with domain E in R™ 
are said to be functionally dependent in an open subset G of E if there 
is a function ¥ from R" to R' which does not vanish identically in any 
open set and which is such that ¥ (f(x), «..»f,(x)) = 0 for x € G. 

The term functional independence has the obvious meaning and 
theorem 7.52 now leads to the following result. 


Theorem 7.61. Let E be a subset of R”. If f = (fi, +. f,)7: E > R" 
is continuously differentiable in the open set G < E and Jf(x) is not 
identically zero for x € G, then fy, ...,f, are functionally independent 
in G. 


Proof. Let § € G be such that Jf(Z) + 0. Then Jf(x) + 0 for x in 
an open subset H of G and /(H) is open. Hence, if ®(/(x)) = 0 for 
all x € G, then ®(y) = 0 in the open set /(H). | 


The pair of functions f;, 2 on R® given by 


A(x, y) = xcosy, f(x, y) = x sin y 
is independent in any open subset of R* since every such set contains 
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points at which the Jacobian x does not vanish. A simple example of 
functional dependence is provided by 


gi(x, y) = cos(x+y), g(x,y) = sin (x+y). 
For the function ¥ on R® given by 
Wu, v) = +v2-1 


only vanishes on the circle u?+v* = 1 and ¥(g,(x, y), g2(x, y)) = 0 
for all (x, y)” € R?. 

The property of linear dependence, familiar from algebra, is, of 
course, a particular case of functional dependence. Another special 
case arises from the next definition. 


Definition. Let E be a subset of R™ and let G be an open set contained 
in E. If the functions 


f= So sft B RY & = (Br + Bp): E > RP 
are such that 2(x) = O(f(x) (xe G) 


for a suitable function © from R" to R°, then g is said to be functionally 
dependent on fin G. 

It is easy to see that, if g is functionally dependent on f, then each 
set of functions f;, ....fns 8; (J = 1, .-» p) is functionally dependent. 
(See exercise 7(f), 7.) 


Theorem 7.62. Let (&, )?(& ¢ R™, 9 € R") be an interior point of a set 
E in R™x R" and suppose that the functions f = (fy, «++s fn)" +E > R™ 
and g = (81, «+ 8p)": E > R® satisfy the following conditions: 
(i) fand g are continuously differentiable in an open set G containing 

(& 0)? 

(ii) J ACE, 1) + 95 

(iii) the function h = (fis «+s fins Sis «++» Sp)” is such that, for 
(x, y)” € G, the rank of the matrix of Dh(x, y) is m. 

Then there is an open set containing (&, 9)” in which g is functionally 
dependent on f. 


Proof. Define the function f*:E x R™ > R™ by 
S*(% V2) =S(x,y)—-z (Hy) EE, z€ RY"). (7.61) 


Then /* is clearly continuously differentiable in an open set con- 
taining (£,7,6)7, where ¢ =f(&, 7%). Also f*(, 7,6) = 9 and 
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Jy f*E 9, 9 = JS(E, 7) + 0. Therefore, by theorem 7.43, there 
are closed intervals 
M = [£,—@, £, +0] x... [Em—% Sm +2, 
N = [n-A, n+Alx + x[n-Bs nth), 
P= [8-2 +A) x... [bn Bs Sn +4] 
and a continuous function ¢:N x P + M such that x = ¢(), z) is the 
only solution lying in M x N x P of the equation f*(x, y, z) = 9. The 
intervals M,N are taken to be so small that MxN<¢G and 
J f(x, y) + 0 in Mx N. 
Fort = 1, say 9s 
SEGO 2), 9,2) = 0 ((y, 2)" NXP). 
Since ¢ has components ¢y, ..., 2m, the chain rule gives 
Dy fi(G(), 2), Vs 2) Dy PVs 2) + + + Din Ffi(OOs 2)s Vs 2) Dj PVs 2) 
+ Dinisf UP) 2); > 2) = 0 
for j = 1,...,. Writing ¢(y, z) = x and using (7.61) we now have 
D, fix, Y) Dj $a, 2) + 01 + Din fi %s Y) Dj PalV> 2) 
= — Ding fil%s ¥). (7.62) 
Now let g*: Nx P + R” be the function defined by 
g*(y, 2) = ad, 2),¥) (0,27 ENxP). 
Considering kth components we obtain from the chain rule 
Dy glx, Y) Dj Pi, 2) +--+ Din Sis Y) Dj Pm(V> 2) 
— Djgk(y, 2) = —Dmij8x(%, Y) (7.63) 
for j = 1,...,, where again x = ¢(y, z). 
Let j and k be fixed. From the linear equations (7.62) correspond- 
ing to i = 1, ..., mand the equation (7.63) we obtain 


| DACs Y).-Dn fis y) | 


. 

DiBk2)) 60x, y)o-Dn ful) 0| 
Dy 84(X; Y)---Dm BCX, ) —1 

D, f(%, Y)-+- Dn Ais Y) — — Ding Al Y) 


| Di ful%s Y)e-DinSnl% DV) — DinsgFonl%s Y)|” 
| Dy g4(%; Y)---Dm 8x(X,¥) ~— — Dinsy Bu; Y) 
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The determinant on the left is equal to —Ja f(x, y) + 0, and the 
determinant on the right is zero, by condition (iii). Hence 


Djgi(y, 2) = 0 
for (y,z)"€NxP. This holds for j = 1,...,” and k = 1,...,m. 


Therefore, by theorem 7.33, given any z <P, g*(y, z) is constant for 
yeN. Let ©:P > R? be the function defined by 


O(z) = g*(y,z) (VEN, zEP). 
There is a positive number r < min (a, #) such that 


fe, ISLE MI < B 


if ||x—£|| < rand ||y—7|| < r. Denote the open balls BE; r)(< R*) 
and B(n; r)(< R”) by U, V respectively. 

Take any point (x, y)? ¢ Ux Vand put z = S(x,y). We then have 
xeM,yeEN,zeP and f*(x,y,z)=9. But, given any point 
(v, w)? eNxP, u = d(v, w) is the only point in M satisfying 


F*(u, v, w) = 9. 


It follows that x = ¢(y,z). Therefore the function ® is such that, 
for (x, y)7 € Ux V, 


a(x, y) = a(40, 2), 9) = 8°02) = PE) = OF; y). 


Incidentally, since ¢ is continuously differentiable on N°x P°, ® is 
continuously differentiable on P°. | 


The theorem is again Jocal. Even if condition (ii) is strengthened to 
Je f(x, y) being non-zero at all points of the open set G (which may 
be connected), there need not be a function ® such that g(x) = O(f(x)) 
throughout G. Take, for instance, 


Fults Xap) = EY COS Xn, fa(X1y Noy Y) = C*Y SIN Xa, 
&(X1, Xa, Y) = C7 *Xp, 


Then Jw f(x, y) = #2” > 0 in R® and the matrix of Dh(x, y) has 
constant rank 2, but clearly different functions ® have to be used in 
the strips 2k < x, < (2k+2)m (k = 0, £1, +2, AaGe 

The analogue of theorem 7.62 in which n = 0 (i.e. y is absent) 
takes the obvious form. The proof only requires an application of the 
inverse function theorem. (See exercise 7(f),9.) Changing our 
notation slightly we now combine the two cases n > 0 andn = 0. 
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Theorem 7.63. Let & be an interior point of a set E in R™ and suppose 
that the function f = (f,, ...sfn)":E > R" satisfies the following 
conditions: 

(i) f is continuously differentiable in an open set G containing &; 
(ii) for x € G, the rank of the matrix of Df(x) is r, whereO <r <n. 
Then there is an open set containing & in which n—r of the functions 

Sis «++» fn are functionally dependent on the remaining r functions. 

(When r = 0 all the functions f, ...,,f, are constant in all con- 

nected open subsets of G.) 


Exercises 7(f) 
1, Show that the functions f, g, h on R® to R' given by 
S(x,y, z) = xsinycosz, g(x,y,z)=xsinysinz, hA(x,y,z) = xcosy 
are functionally independent in every open subset of R*. 
2. Show that the functions f, g on R® to R' given by 
f(y) = xyte™, g(x,y) = xy-e 
are functionally dependent in R*. 
3. Prove that there is an interval [—«, «]® x [—/, #]° in R® in which the equations 
x+y+z= u?+0, 

xt+y2+z? = v+y, 

xi+yi+z% = witu 
have a unique solution u = ¢,(x, y, z), v = $,(x, y, z), W = G(x, », z). Prove 


also that ¢,, $2, #3 are functionally independent in (—«, «)°, 


4. Prove that the functions f,, ...,f, on E(<R™) to R! are functionally de- 
pendent in the open subset G of E if and only if f(G) (where f = ((, ..., f,)7) has 
no interior point. 


5. Given a real-valued function F on a metric space (X,/), denote the set 
{x € X|F(x) + 0} by A. Then the support of F is defined as the set A (i.e. as the 
smallest closed set outside which F(x) = 0). 

Let f= (f,, ...,f,)" be a function with domain E in R™ and range in R*. 
Show that f,, ..., f, are functionally dependent in an open subset G of E if and 
only if there exists a function ¥" from R* to R' which is such that its support 
contains f(G) and VY(f(x)) = 0 for xe G. 


6. The real-valued functions /,, ...,f, with domain E < R™ are functionally 
dependent in an open subset G of E. Show that, if g is any real-valued function 
on E, then fj, ..., fn, g are functionally dependent in G. 


7. Let E be a subset of R” and let G be an open subset of E. Show that if, in 
G,g: E- R’ is functionally dependent on f= (f, ...,f,)7: E> R", then the 
set of functions /;, ..., f,, g is functionally dependent in G, 
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8. The (continuously differentiable) real functions fi, fy are defined by 


on 
faa 8, ay = FM OD 


Show (by use of 4) that f,, f: are functionally dependent in R’, but that neither of 
fs fzis functionally dependent on the other in any open set containing the origin. 


9. The set G in R” is open and the function /: G > R” is injective. Prove that any 
function g: G > R? is functionally dependent on fin G. 


10. The functions f, g, h on R* to R are given by 
Sy) = 40°-y), ey) = xy, h(x, y) = Ge +4) cos x. 
Show that, in R*, A is functionally dependent on f, g. 


11. The functions f, g, 4 on R‘ to R? are defined by 
Sf(w, x, ¥, 2) = wtxty+z, ow, x,y, Zz) = wtxtt+yi+z3, 
h(w, x, ¥, z) = wW8+x9+y8+29°—3(xyz+yzw+zwx+ wry). 


Show that, in R‘, A is functionally dependent on f, g. 


7.7. Maxima and minima 


A real valued function f on a set X in R™ is said to have a (local) 
maximum at the interior point £ of X if there is a 6 > 0 such that 
F(x) < f(é) whenever x € B(E; 8); a minimum of fis similarly defined. 
The corresponding definitions in C1 for functions on R? (§4.7) and 
on R? (§8.8) differ slightly in requiring strict inequalities for x in 
B(E; 6)—{&}. We have here adopted the more comprehensive defini- 
tion because in this chapter it will be convenient to be sure that a 
function has a maximum (minimum) at a point where it assumes 
its supremum (infimum). 

It is easy to see that, when f is differentiable at , a necessary 
condition for fto have a maximum or minimum at is that 


Df(é) = 9, 


the zero linear function. (See exercise 7(g),1.) There are also 
sufficient conditions for a maximum or minimum; the cases m = 1, 2 
are treated in C1 (§4.7, 8.8); for the general case see exercise 7(h), 6. 
However our present concern is to extend the theory in a different 
direction: we shall consider maxima and minima of functions relative 
to the values taken on subsets of their domains, The most interesting 
case is that in which the subsets are determined by equations of the 
form g(x) = 4. 
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Definition. Let X be a subset of R™ and let g be a function on X with 
values in R2, where 1 < q < m. Denote the set {x|g(x) = 0} by Xo 
and suppose that the point & in X, is an interior point of X. The function 
f:X > R' is now said to have, at &, a maximum [minimum] subject 
to the constraint g(x) = 0 if there is a 6 > 0 such that f(x) < f(&) 
[f() = £()] whenever x € Xo BCE; 4). 


The next theorem gives a necessary condition for a constrained 
maximum or minimum to occur at a given point. 


Theorem 7.71. Let & be an interior point of a set X in R™(m > 2) and 
suppose that the function g = (81, ..., 8g)": X > R4%, where < q < m, 
satisfies the following conditions: 
(i) g(&) = 9; 

(ii) g is continuously differentiable in an open set G containing £; 

(iii) the matrix of Dg(&) has (maximum) rank q. 
If the function f: X + R* is also differentiable in G and if f, subject 
to the constraint g(x) = 9, has a maximum or a minimum at the point 
£, then there are real numbers A, ..., A, such that 


Df (6) +Ar Di 81(8) +... +Ag Di &,(8) = 0 (7.71) 


GOP Viraecs ht: 
The numbers Aj, ..., A, are called Lagrange’s multipliers. 


Proof. We may suppose that 


Dyy—g181(8)--- Dn B(E) 
i rd # 0. (7.72) 


Dmn-a+1 8a §)-+» Dn Sal) 


Now put p = m—gq and regard f,g as functions with domains in 
R? x R@. Also write & = (9, )7 (ye R®, Fe RY. 
By the implicit function theorem there are an open interval 


MP? = (1 -% +4) X 26 X (My = Ls Mp +) 


and a continuously differentiable function 6 = (¢y, ..., 62)": M° > R? 
such that ¢(7) = € and 


a(y, $y) = 9 for yeM?. 
Take any he R” and let Dé(y)(h) = k(€ R2). By equation (7.45) 
we then have p., e(7, O(h) + Darga, Ok) = 9; 
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and, by theorem 7.42, this is equivalent to 
Dg(n, O)(h, k) = 9. (7.73) 
Define the function yf = (jy, «.-» Wn)" i(—&, %) > R™ = RP*4 by 
m+ th; (i <i<p), 
Pi-pm+th) (p+1 <i < p+). 
Then, by the chain rule, 


vO = | 


hy (l<i<p), 
D$i-p(m() (pt1 <i < pq). 
Since D¢()(h) = k, the last line may be written 
Yr) =k (l</ <q). 
Next, let x = fo y, so that 
x(t) = ftth, dq+th) (-«#<t< a). (7.74) 


Then y has a maximum or a minimum at 0 and so x’(0) = 0. Using 
the note after theorem 7.22 we therefore have 


0 = xO = Df, o¢™) "'O) = Dfa, NYO) 
= Dif, hy +.--+ Def hp 
+ Dy f(, kit +--+ Dpsah, YK (7.75) 


We have shown that, given h € R”, there is k € R? such that (7.75) 
and (7.73) hold. Putting 


Dif, 8) = ais Digi, 9) = by 
fori = 1,....m = p+qand/ = l,...,q we express these equations as 


Vi) = | 


Ahy +... + Gp Ap +apyy Kat... +Apiq hq = 0, 
Dy hy + oe. + Dry hp +B1,patka t+ +51,p+10k9 = 9, 


Dah t + Dap hp + bq, pitkit ++ 0aniaka = 9- 
Moreover (7.72) now takes the form 


Drea Unpra 


sae af (7.76) 
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The q+1 vectors 
(Grtsie-lgag) 238 | (Diggets =-+5 by pig)" vey Oat oo Ue) 


(each with q components) are linearly dependent, i.e. there are 
numbers Ao, Ay, ..., Ay, not all zero, such that 


Ag(Aptar «++s Brag)” +Ar(Bs, prt» +++9 Di pag)? Hee 


+AQ(bg, p41 +19 Dang)? = 9. 


But, by (7.76), 
rps» sory Di p+a)”> ney (bo.p+1 easy ee 
are linearly independent and so we may take A, = 1. Thus 
Apt t Ady put. FAgby pu = 9 (7.77) 
forifien A, 5-5 


Now, for a fixed 7 between 1 and p, take A; = 1 and h, = 0 for 
1 <r<p,r +i. There are ky, ..., k, such that 
A;+Apiiky +...+4pig ky = 0, 
byt By pitkit-.-+b pigky = 0, 


byt bgpstkit.-»+Bgpsqkq = 0. 


Multiply these equations by 1, Aj, ...,A, respectively and add. In 
view of (7.77) we have 


a; +A byt... +Agbg = 0 (7.78) 


and this holds for i = 1, ..., p. The two sets of equations (7.78) and 
(7.77) combined are equivalent to (7.71). | 


In a situation of the kind described in theorem 7.71, the multipliers 
Ay, «+», are of no particular interest and their role is mainly 
auxiliary. The q equations g,(£) = 0, ..., g,() = 0 and the m equa- 
tions (7.71) make up a set of m+q equations for the m+q unknowns 


bay wey Sash Mioiease Ay: 


The points (£), ..., §,)” obtained in this way are called critical points, 
and among them are any points of X at which constrained maxima or 
minima occur. There remains the final investigation whether a given 
critical point actually yields a maximum or minimum. This is usually 
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best carried out on an ad hoc basis, for, although a general procedure 
exists, it is cumbersome. (References will be found in the notes at the 
end of the chapter.) However the related problem of finding the 
largest and least values of f (as distinct from /ocal maxima and 
minima) is often quite simple. For suppose that fis differentiable and 
g is continuously differentiable on the open set Y, that Dg(x) has 
maximum rank throughout X and that the set X, defined by the 
equation g(x) = 4 is compact. Then f assumes its bounds on X». 
Moreover, if £ is a point of X, at which a bound is attained, then the 
corresponding function y of (7.74) has a maximum or minimum 
at 0. This means that £ is a critical point. Thus, to obtain the bounds 
of f on X, it is only necessary to compare the values of fat all critical 
points. 


Example, An ellipse in R® is given by the equations 
Ce Jy, 2) = 2x +y'—4 = 0, 
a(x, yz) = xt+y+z=0, 


Find the points on the ellipse which are (a) nearest to and (4) furthest from 
the y-axis. 
We wish to find the points at which 
L,Y, Z) = +23, 


subject to the constraint g(x, y, z) = 9, takes its largest and least values. 
The two determinants 


Dye(x, ¥,z) Dsei,¥,2)| _ [4x H ae 
Dyg2(x,¥, 2) Dsgalx, ¥; 2) et Z 
Dagilx, ¥, 2) Dagilx, Ys 2)| _ a H mee 
D2glx, ¥, 2) Ds Bo(X, ; 2) te 1 


cannot both vanish at a point satisfying g,(x, y, z) = 0, Hence theorem 7.71 may 
be used and, at a point giving a constrained maximum or minimum, the 


equations Ax+A4x+A, = 0, 
A,2y +A, = 0, 
2z +A, =0 
hold for suitable values of A, and A,. Therefore, at such a point, 
De cAiey Al 
QO 2y 1/=0, 
22770) t 


ie. xy+z(2x—y) = 0. 
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Substituting for z from g.(x, y, z) = 0 we get 
2x*-y*? = 0. 
The equation g,(x, y, z) = 0 now gives x* = 1. The critical points are therefore 
p= (1,2, 1-2)", q = (1,—2, —1+2)?, 
r= (-1,2,1-42)7, s = (-1, —2, 1442)". 
Since f(p) = f(s) = 44242 
and SQ) = fr) = 4-242, 


the points q, r are nearest to and the points p, s are furthest from the y-axis. 


Exercises 7(¢) 
1. Show that, if the real-valued function fon the set X < R” is differentiable at 
the (interior) point of ¥ and hasamaximum ora minimumat&, then Df(é) = ©. 


2. Prove the following generalization of Rolle’s theorem. Let G be a bounded, 
open set in R” and let the function /: G- R' be continuous on G and dif- 
ferentiable in G. If f is constant on frG, then there exists a point £ € G such 
that Df(é) = 9. 


3. Find the largest and least values of xy subject to the constraint x*+xy+y? = 1. 


4. Find the largest and least values of (y—z)(z—x)(x—y) subject to the con- 
dition x?+ y?+z? = 2. 
5. Obtain the maxima and minima of 
y+ 2*—yz—2x— xy 
subject to the condition 
x*+y*+z9—2x+2y+6z+9 = 0. 


6. Calculate the dimensions of the rectangular box of largest volume which can 
be made from a sheet of area a’, if the box is (i) to have a top, (ii) not to have 
a top. 


7. Find the largest and least values of x*+y%+z* subject to the conditions 
xt+y2+2? = landx+y+z=1. 


8. Obtain the largest and least values of 
2x+yt+z)—xyz 


on the closed ball {(x, y, z)7|x*+y?+z? < 9}, 
(Consider 2(x + y+ z)— xyz (i) without restriction, and (ii) under the constraint 
xt+yt+z" = 9.) 


9. Find the points of the set in R* defined by 
xtz=1, 4x°+)' < 16 


which are, respectively, nearest to and furthest from the origin. 
(Consider x*+y?+z* under the constraints (i) x+z = 1, (ii) x+z = 1 and 
4x¢+y? = 16.) 
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7.8. Second and higher derivatives 
The purpose of this section is to give a short account of linear 
derivatives of order higher than the first. The notion of partial 
derivative of arbitrary order is taken for granted (see C1, 154) and 
we now only fix the notation. If fis a function from R™ to Rt 
D; D,f(é) means D,(D,f(é)) and D; D;f(&) is abbreviated to D?f(&). 
For partial derivatives of higher order the notation is analogous. 
Although in §7.1 linear derivatives were defined only for functions 
from R™ to R", we remarked that precisely the same definition may 
be adopted for functions with domain and range in any normed 
vector spaces. Now, when /f is a function from R™ to R", Df is a 
function from R” to the normed vector space L(R™, R"). We can 
therefore speak of the linear derivative of Df and the definition below 
is the natural consequence. 
Definition. Let the function f:X + R", where X < R”, be differenti- 
able on the subset X, of X; and let & be an interior point of X;. Then 
fis said to be twice differentiable at £ if Df is differentiable at §, i.e. 
if there exists a linear function wR” > L(R™, R") such that 
DfEE +h) eee +0 as || +0 
(where the norms in numerator and denominator are those inL (R™, R") 
and R” respectively); the linear function u is called the second linear 
derivative of f at & and is denoted by D*f(&). 
It is easy to prove (as in theorem 7.11) that second linear deriva- 
tives are unique. 
When fis a function from R” to R” and is twice differentiable at £, 
D*f(é) e L(R”, L(R”, R")), 
D3f(E)(u) eL(R", R") (ue R”), 
DYE WER" (uve R"). 

The function D2/(é) is not easy to visualize; but D?/(g)(.)(.) is 
simply a function from R™ x R” to R". It is the function x defined by 
xu, 2) = DFW) (uy ve R”), 
which turns out to be bilinear. By this we means that x(u, .) is a 
linear function (on R”) for every we R™ and y(., v) is linear for 

every v € R”. In other words, 


x(cu, v) = x(u, cv) = exw, v) 
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and 
XE+U, ve) = XE Y)+XU, 0), XU, V+W) = Xu, v)+X(u, W) 


for every c € R! and all t, u, v, we R”. This is very easy to see. First 
xu, .) = D*f(£)(u) is linear, as D®f(§) has values in L(R™, R”). 
Secondly, since D2f(£) is linear, 


D*f(&)(cu) = cD*f(E)(u) 
and Df(E\(t+u) = DY(E)(Y+ DLO), 
that is, for every v, 
D*f(E)(cu)(v) = cD*f(E)(u) (v) 
and Df(E)(¢+u)(v-) = DFE)OW) + DAO WM). 
We shall show further that x(u, v) is symmetric in u, v, but the proof 
is rather more difficult. 


Theorem 7.81. If the function f:X > R", where X < R™, is twice 
differentiable at the point &, then the bilinear function D®f(£)(.)(.) is 


symmetric, ie. parey(u)(v) = DY) 


for all u,v € R™. 


Proof. Let € be any positive number. There is an open ball B(£; 3d) 
(in X) within which f is differentiable and such that 


| DFE +n) — Df(E)- DYE) || < ella) (7.81) 
whenever 7 € B(£; 30). Take any points h, k in B(€; 6) and put 
A =f(E+h+k)-f(E+h)-f(E+k +f). 
Now define the function g: B(@; 20) > R" by 
a(x) = f(E+h+x)—f(E+x) (\|x|| < 28), 


so that A = g(k)—g(0). 
Then g is differentiable in B(@; 20) and 
Dg(x) = Df(E+h+x)— Df(E+x). (7.82) 


Also, by exercise 7(c), 3, if S is the closed ball with centre @ and 
radius ||k||(< 6), 


|A—Dg()()|| = lek) -g(0) — De) (&)|| 
< (sup | Dg(x)— Dz(®)|) II. (7.83) 
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Let x eS. Then, by (7.81), 
| DAE +h+x)— Df(Q)—DY(OHh+x)| < e(lAl +l) 
and | Df(E+x)— Df(E)-— DF) < 
so that, by (7.82), 
|De(x)— DYE) MI < e(lAl| +2|x]) < 2¥( 
It follows from (7.84) and (7.83) that, first, 
| Dg(x)— Dg()|| < 4e(\hl| +]kl) eS) 
and then |A— D4f(E)(h)(K)||_ < 6e(||Al| + AI} |]. 
Since A is symmetric in A and k we also have 
JA—DYDEHM| < 6e(\Al + [eI IA 
and therefore 


|| D9f(E) (A) (k) — DYF(E)(K) (H)||_ < 6e( Al] + |] A|)*. 

The last inequality was proved under the assumption that ||Al, 
|kl| < 6. But, if u, v are any points of R", we may choose the positive 
number @ so that ||au||, ||«v|| < 6 and then 
IDFOHMO)-DFOO M) = || D(E) Gu) ev) — D7f(E) x) (cas) | [a 

< Ge(\|au|| + [lav])?/o% = 6e(|lu] + |lol|)*. 
As this inequality holds for all ¢ > 0, the left-hand side must be 0. | 


ela, 


hi +||k\|). (7.84) 


It is not difficult to show that any bilinear function y on R™ x R™ 
to R” is of the form 


m ™ 
xu, v) = > Pp A yzv, (U = (Uy, «005 Um)?s 0 = (Vs «+3 Um)” € R™), 
i=1j=1 


where the a‘/ are constant vectors in R”. We shall show that, for 
Df(E)(.)C); 
ai = D:D; f() = (D:D; A), --» Di Dy fnlE))”- 


The proof does not require the general result just mentioned; it 

follows from the next theorem which has independent interest. 

Theorem 7.82. Suppose that the function f = (fi, ..sfn)7:X > R", 

where X < R”, is differentiable in the set X, < X and let v be any 

given point of R™. If f is twice differentiable at & (€ X,), the function 
Dy fir, +... + Dn fin 

g = Df(.)(U) =| cre rete eee eters (7.85) 

Dy frit. + Dintn?m 
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from X, to R" is differentiable at & and 

Dg(&) = D*f(é)(.)@), 
ie. Dg(E)(u) = DEW) WER”). 


Proof. Let 
Df(E +h) — Df(&) — D3f(£)(h) = r(h) 


so that r(h) e L(R”, R”) and |\r(h)|| = o(||h\|) as ||| + 0. Then 

Df(E +h)(v) — Df(E)(v) — D3f(E)(A)(v) = r(h)(@) (7.86) 
and ||r(A)(v)||_< ||r(A)|) ||vl| = o(|||) as ||A|] > 0. But the left-hand side 
eevee a(E+h)—g(6)— DAE) 


and D?f(£)(.)(v) is a linear function on R”™ to R". Hence g is 
differentiable at £ and 


Dg(&) = D°f(E)(.)@). | 


Theorem 7.83. If the function f = (fi, ...,f,)":X > R", where 
X ¢< R”, is twice differentiable at the point £, then 
(i) all the partial derivatives D; D; f,() (i,j = 1, ....m;k =1,....n) 
exist; 
(i) D,D;fi.(S) = DD: fi) GJ =1...,m;k = 1,...,n)5 
iii) for all u = (Uy, «1-5 Um)?, V = (Vy, «+15 Um)” € R™, 


z z D; D; f()ui v; 
pee & > D;D;f(@)uivy = Povrrcr scree eee ee es 
> 5 D, Dj frlé)ucv; 
i=1 j=1 
(7.87) 


Proof. In theorem 7,82 take v = e/ (the vector with jth component 1 
and other components 0). Then the function 


gi= Dif = (Dyfi + Dj fn)” 


is differentiable at £ and so, by. theorem 7.13, all partial derivatives 
of D; fi, ..., Dj f, exist at &. This is true for all j and therefore (i) 
follows. 
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Now take an arbitrary v¢ R”. The function g given by (7.85) is 
differentiable at £ and the matrix of Dg(&) is 


(: Dy fi(E)01 +--+ Din (EW +++ Dink Di i(S)e1 + +» Se 


Di[Dy fn(E01 + +++ Din fr(EUm)--» Din Dr ful EUs + +++ + Din fn Ema 


Since each D; D, f,(&) exists, the formula D®/(£)(u)(v) = Dg(£)(u) 
now gives the expression (7.87). 
To prove (ii) we use (iii) and theorem 7.81. We have 


D,D,f(é) = DYE) (eC) = DEE) (e') = Di D:SE). | 


It may be shown that the existence and continuity of all second 

order partial derivatives of a function ensure that the function is 
twice differentiable (cf. theorem 7.14). For this reason, part (ii) of 
theorem 7.83 invites comparison with theorem 7.83 of C1, where it 
is proved that D,;D,f,(£) = Dj; Di f(g) if D; Dif, and D;D;f, are 
continuous at & Two further results of the same type are embodied 
in exercise 7(h) 3, and in the theorem below which will be needed in 
chapter 10. 
Theorem 7.84. Let f = (fi, ...f,)" be a function with domain 
X < R”™ and range in R"; and let & be an interior point of X. If Dif, 
and D;f;, exist in an open set containing £, and are differentiable at &, 
then D;D;fi(é) = Dj Di fil). 


Proof. It is clearly sufficient to take m = 2 and n = 1. We there- 
fore have to show (with a slight change of notation) that 


D,D.f(&, 1) = D:D: f(é, 1). 


Suppose that D,f, D,f exist in an open ball with centre (¢, 7)” and 
radius 20. For 0 < |h| < 6, put 


Ah) = fE+h, n+ h—-f(E+h, N—-f(E 7+h) +FE, 1). 
We now define the differentiable real function g on (—4, 3) by 
a(x) = f(E+x, 7+h)—-f(E+x, 1) [x] < 4). 
Then A(h) = g(h)—8(0) 


and, by the mean value theorem, there is an « such that 0 < « < 1 


A(h) = hg'(ah) = h{D,f(E+ah, 1 +h) — Dif(E+ ch, 1}. 
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But, since D,f is differentiable at £, 


D,f(E+eh, 9 +h)— Di f(& 1 
= Dif(é n)ah+ Dz Di f(E, 1)h + o(||(zh, h)||) 
and D,f(E+ah, 9)— D,f(&, 1) = Dif(é, Nah + o(|\(ah, 0)|). 
Hence, as h +0, 
A(A)/h® = Dy Di f(E, 1) + o(V(@ + 1) +2), 

ie. A(h)[h? > Dz D,f(&, 1). 

By symmetry, we also have 

A(h)/h? + D, Dz f(é, 7) as h-0. | 


Linear derivatives of any order are defined inductively and give 
rise to multilinear functions. For instance D®f(£) is the linear deriva- 
tive at & of the function D?f whose domain is in R” and range in 
L(R™, L(R™, R")); thus 


D8f(~) € L(R™, L(R™, L(R™, R”))). 


The function D®f(£)(.)(.)(.) is much less complex. It is simply a 
trilinear function from R™ x R™ x R™ to R” and is given by 


DYMO) = | EE DD, D.Ouryw 


Exercises 7(h) 
1. Let X be an open subset of R™ such that tx € X¥ whenever x € X¥ and t > 0. 
Let the function f: X > R' be twice differentiable and homogeneous of degree « 
(see exercise 7(b), 3). 
ners DY(H)(9)(2) = a(e—D FC) 
for all xe X. 
(ii) Prove that, if « = 1 and all second order partial derivatives of f are con- 


tinuous, then D,Dyf(x) «. DD, fe) 


D:D f(X) «+ DinDnf (X) 


for all xe X, 
(The determinant is called the Hessian of f and is denoted by Hf(x); it is 
equal to Jg(x), where g = (Dif, ..., Dnnf)”.) 
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2. Show that the function f: R? > R' given by 
xy(x*— y*) 
a » 0, 0)), 
gue | Spr 9) * 0) 
0 (, ») = ©, 0) 
is differentiable everywhere and that all four second order partial derivatives 
exist everywhere, but that D,D,f(0, 0) + D,D,f(, 0). 


3. The function f from R? to R' is continuously differentiable in an open set G 
* containing the point (&, 7)”. Prove that, if D,D,/ exists in G and is continuous at 
(é, 9)”, then D,D,f(&, 7) exists and is equal to D,D,f(é, 7). 
(By considering 


Ath, k) = fE +h, nt h)—-SE, 1+ -LE+h, N+ FE, 
show that, given h, k + 0, there exist «, # such that 0 < a, # < 1 and 
{DifE+oh, n+k)— DifE+ah, milk = (DafE+h, 1+ bk) — DofE, 1+ BY; 
and prove that the left-hand side tends to D,D,f(é, 7) as (h, Kk)” + (0, 0)7.) 


4. Three sets of conditions for the equality of mixed partial derivatives have been 
given in the present section, Construct a function which satisfies none of these 
sets of conditions but is nevertheless such that D,D,f(é, 7) and D,D,f(&, 7) 
exist and are equal. 


5. Taylor’s theorem in R™. Let X be a subset of R” and & an interior point of X. 
The function f: X + R' is such that all partial derivatives of order p are con- 
tinuous in an open ball B(é;r). Show that, when ||| < r, there is a number a 
between 0 and 1 such that 
sf 
SE+H = fO+ IOM+5, DIOM +... +o) ae (Ay 


* Fy Df(E+ ah) (h)?, 


2 
@-1)! 


where D*f(£)(h)* = D*f(E)(A) (A), ete. 
(D*f(&)(h)* may here be regarded as shorthand for 


m 


eo Day «+. Dig fO)hiy +++ ins 
it rs 
though, in fact, the continuity of the pth order partial derivatives implies the 
existence of the linear derivatives up to order p. 
Define the real function g by g(t) = fG +th) (|t| < r/\|Al]) and use Taylor’s 
theorem in R! (Cl, 81); the case m = 2 is dealt with in Cl, 163.) 


6. Let & be an interior point of the set X¥ in R”. Suppose that the function 
Sf: X > R* has continuous second order partial derivatives in an open set con- 
taining § and that D,f(é) = ... = D,f(€) = 0. Using the notation 


D,D,f(&) ... DeD FE) 
Hy f(6) = | creer terete 


D,D, f (6)... DiDe f ©) 
for k = 1,..., m, show that 
(i) if Hf > 0 for all k, then f has a minimum at £; 
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(ii) if H,.f(€) < 0 when k is odd and H;,f(€) > 0 when k is even, then fhas a 
maximum at £; 

(iii) if either H,.f(€) < 0 for an even k, or H,f(€) > 0 for an odd k and 
also H;,f(&) < 0 for an odd k, then fhas neither a maximum nor a minimum at &. 

(For the case m = 2 see Cl, theorem 8.8. 

The hypotheses in (i), (ii) and (iii) respectively, are equivalent to the following 
properties of D?f(é): 

(i DE) > 0 for all u + 6; 

(ii)’ D2f(E)(u*) < 0 for all u + 0; 

(iii)’ D®f(E)(.)? takes values >0 and <0. 
This is proved in most books on linear algebra (e.g. L. Mirsky, Linear Algebra, 
400-407).) 


7. Find the maxima and minima of the function f: R* > R' defined by 
S(x, ¥, Zz) = x2 + y®+29+ Qxyz, 
What is the least value of fin the closed ball 
{(x, y, Zz)? |x*+y? +2" < a}? 
8. Show that the function f: R? > R' given by 
L(x, y) = x*y—4x°-2y? 


has no minima. Deduce that, if K is any compact subset of R*, then / attains its 
infimum on K at a point of the frontier of K. 


NOTES ON CHAPTER 7 


§7.1. In the context of the long history of the calculus a rigorous treatment of 
functions of several variables is surprisingly new. As late as 1909 the definition of 
differentiability of a function from R? to R' was the subject of a research paper 
(W. H. Young, ‘On differentials’, Proc. London Math. Soc. 7, 157-80). However 
subsequent progress was rapid. By 1925 Fréchet had produced a theory of differen- 
tiation on normed vector spaces; and in 1927 T. H. Hildebrandt and L. M. 
Graves published a parallel but independent account which included an implicit 
function theorem (‘Implicit functions and their differentials in general analysis’, 
Trans. Amer. Math. Soc, 29, 127-53). Recently, Dieudonné’s Foundations of 
Modern Analysis has been most influential in disseminating the modern theory of 
differentiation. 


§7.4. The limitations of the implicit function theorem 7.43 are vividly 
illustrated by the simple case of f(x,y) = (x—y)*. Although the equation 
f(x, y) = 0 has the unique solution y = x, the conditions of 7.43 are nowhere 
satisfied since D,f(x, x) = 0 for all x. There exists a theory in which differen- 
tiability conditions are avoided, but only at the cost of considerable complica- 
tions. (W. Quade and S. Schottlaender, ‘Uber implizite Funktionen’, Math. 
Zeitschrift 89 (1965), 137-80.) 


§7.6. A converse of theorem 7.61 is true: if the function f= (f, ...,f,)” is 
continuously differentiable in an open set G and Jf(x) = 0 for xeG, then 
AA; +.) fy are functionally dependent in every bounded open subset of G. Proofs of 


NOTES 245 


this result are long and not easy. The first one is due to K. Knopp and R. 
Schmidt (‘Funktionaldeterminanten und Abhangigkeit von Funktionen’, 
Math. Zeitschrift 25 (1926), 373-87); a highly sophisticated account has recently 
been given by W. F. Newns (‘Functional dependence’, Amer. Math. Monthly 74 
(1967), 911-19). However if the condition Jf(x) = 0 for x € G is replaced by the 
more restrictive one that the matrix of Df(x) has constant rank r < n, then we 
have the situation of theorem 7.63 where there is, though only locally, the 
stronger conclusion that n—r of the functions f;, ..., , are functionally dependent 
on the remaining r functions. 
The fact that in theorem 7.63 the rank must not be variable is shown by the 
function f = (f,, fx)? : R* > R* defined by 
x4 sin (1/x) (x + 0), 
Ko) =, fn = [nO =F 
(x = 0). 


The rank of the matrix of Df(x, y) is 1 when x + 0 and is 0 when x = 0; and it 
follows from exercise 7(/), 8 that, in any open set containing a portion of the 
line x = 0, neither of the functions f,, f is functionally dependent on the other. 


§7.7. For conditions sufficient to ensure the existence of a constrained maxi- 
mum or minimum at a critical point, see H. Hancock, Maxima and Minima, 
chapter vi. 


§7.8. Linear derivatives of arbitrary order are best studied in the general 
setting of normed vector spaces (as in Dieudonné’s book). For even if the function 
fhas values in R", so that Df(é) has values in the same space, D®f(£) and higher 
linear derivatives have their values in vector spaces of linear functions. 


8 
INTEGRALS IN R" 


8.1. Curves 


A function f on the closed interval [a, b] (and with range in R") is 
said to be differentiable at a or b if the appropriate one-sided deriva- 
tives exist at these points (C1, 66); and f is called continuously 
differentiable if the derivative exists at all points of [a, b] and is con- 
tinuous on [a, b]. (This supplements the definition of continuous 
differentiability for functions with open domains which was so 
extensively used in chapter 7.) The function f is called piecewise 
continuously differentiable on [a, b] if there is a dissection 


A=, <a <...< 1 <Q =b 


such that the restriction of f to each interval [a; _;, a,] is continuously 
differentiable. Thus, in particular, f is continuous on [a, b] and has 
one-sided derivatives at the points a;,. 

We are now ready to discuss the notion of a curve in R"(n > 1) 
or Z. 


Definition. A transit in R” (or Z) is a continuous function whose 
domain is a finite closed interval in R! and whose range lies in R” (or Z). 

We distinguish between the transit, which is a function, and the 
range of this function, which is a set of points in R” (or Z). Many 
different transits may have the same range. 

To obtain a curve we group together certain transits. Two transits 
¢:[a, b] > R" (or Z), y:[c, d] > R” (or Z) are called equivalent, and 
we write ¢ ~ yf, if 6 = you, where « is a real function on [a, 5] 
with the following properties: 

(i) (a) = ¢, a(b) = d; 
(ii) & is piecewise continuously differentiable; 

(iii) for a < t < b, a(t) and, where this does not exist, each one- 

sided derivative of «, is strictly positive. 
It is not difficult to see that the relation ~ so defined is, in fact, an 
equivalence relation (see exercise 8(a), 1). 


Definition. An equivalence class of transits is called a curve. Any 
member of the equivalence class constituting a curve y is called a 
representation of y. 
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All the representations of a curve y have the same range. This set 
of points is called the trace of y; it is compact and connected, being 
the image of a compact and connected set by a continuous function. 
If ¢:[a, b] > R” (or Z) is a representation of y, the points $(a), (b) 
(which are the same for all representations of y) are called the 
initial point and the end point of y, respectively. 

Our definition of a curve is intended to convey the idea that a 
curve is a method of description of a certain set of points (its trace); 
also that such a set of points may be described in many different ways 
which, however, do not differ in essentials. The definition auto- 
matically excludes the possibility of a single curve being indicated 
by both sets of arrows in each of the illustrations below. 


42S 


A curve y’ is said to be an arc of a curve y if there exist a repre- 
sentation ¢ of y with domain [a, b] and a representation y of y’ with 
domain [c, d] such that [c, d] < [a, 6] and y is the restriction of ¢ to 
[c, d]. 

If a transit is piecewise continuously differentiable, then every 
equivalent transit has the same property. We can therefore speak of 
piecewise continuously differentiable curves. They will be called 
paths. 

A rudimentary algebra of curves is useful. We begin with the 
operation of addition. Let 7, ...;7%m be curves such that, for 
i=1,...,m—1, the end point of y; coincides with the initial point 
of 7:1. For each i take a representation ¢* of y; whose domain is the 
interval [i—1, i]. Since (i) = ¢*+(i), the function ¢ on [0, m] 
defined by 


$() = $() for i-1<t<i @=1,...,m) 


is continuous and so generates a curve y. It is not difficult to see 
that y does not depend on the particular choice of functions ¢* (see 
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exercise 8(q), 3). We therefore define y to be the sum of 7, ...; Ym 


and write 
Y = Vite t+¥m 


Clearly, if 74, ...,%m are paths, then y is a path. 

If ¢ on [a, 5] is a representation of a curve y, then ¢* on [—b, —a] 
aloes #0 = 4(-) (-b<t< -a) 
generates a curve with the same trace as y, but with initial point 4(b) 
and end point ¢(q). It is natural to denote this curve by —y. Evidently 
—(-y) =y. A sum y,+(—72) is, as usual, written y,—y,. Note 
that 

=F +%m) = Vm += Ve 


It is easy to formalize the intuitive idea of the length of a curve. 
To avoid repetition we confine ourselves to curves in R”; the treat- 
ment for Z is entirely analogous. 

Our definition of curve length is derived from the ancient device 
of inscribing polygons. Let ¢ on [a, b] be a transit in R”. For any 
dissection of [a, b] given by 


GA bond ty. Sic bg Shy amy 
m 
put A(@, #) = ¥ i694]. 
We note that, by the triangle inequality for norms, the insertion of 
new points of subdivision increases a sum A(Q, ¢). 
Definition. If \(2, ¢) is bounded for all dissections D of [a, b), the 
transit @ is said to be rectifiable and 


Aud) = sup M7; ?) 


is called the length of ¢. (For an alternative definition see exercise 
8(a), 10.) 

Let ¢ on [a, b], on [c, d] be equivalent transits in R”. Then there 
is a continuous, strictly increasing function « on [a, 5] such that 
aa) = c, a(b) = dand 

dt) = Ye} (a <t < d). 
Since the inverse function «- is also strictly increasing, the relations 
u=at) @<t<b), t=a4@ (C<u<ed 


set up a bijection between all the dissections of [a, 5] and all the 
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dissections of [c, d]. Also, if 2, 2’ are corresponding dissections of 
[a, b] and [c, d] respectively, then 
AQ, 9) = AB’, Y). 

Hence ¢ and y are either both rectifiable or both not rectifiable and, 
if they are rectifiable, they have the same length. It follows that we are 
justified in applying the terms rectifiability and length to curves as 
well as to transits. We shall denote the length of a rectifiable curve 
y by A(y). 


Theorem 8.11. The curve in R” represented by ¢ on [a, b] is rectifiable 
if and only if each of the components $4, ..., bn of ¢ is of bounded 
variation on [a, b]. 


Proof. For y = ()15 «++» Yn) in R” we have 
Il < Ill < Ivlt+..-+lyal @ = 1.57). 
Therefore, for any dissection J of [a, b] and i = 1,...,”, 
VD, $i) < AQ, $) < VP, by) +--+ WF Gn) (8-11) 

and these inequalities lead to the required result. | 
Theorem 8.12. Let , V1, ¥2 be curves such that y = Y¥1+¥2. Then (i) y 
is rectifiable if and only if y, andy. are rectifiable and (ii) when y is 
eg AG) = AQ) +AQ%)- 

The proof is very similar to that of theorem 6.42 and is left to the 


reader. Part (i) is also an immediate consequence of theorems 8.11 
and 6.42. 


Theorem 8.13. Every path in R” is rectifiable; and, if ¢ on [a, b] is a 
representation of a pathy in R", then 


Aq” = ['I¢'l (8.12) 


Proof. The function ¢ is piecewise continuously differentiable. 
Hence [a, b] may be divided into a finite number of subintervals in 
each of which the components ¢,, ..., 6, have bounded derivatives. 
Thus ¢,, ..-, ¢, are of bounded variation in [a, 5] and so, by theorem 
8.11, y is rectifiable. We next note that the integral in (8.12) exists 
although the integrand may be undefined at a finite number of 
points; for, elsewhere in [a, 5], ¢’ is bounded and continuous. To 
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prove the identity (8.12) we shall suppose that ¢ is continuously 
differentiable throughout [a, b]. This is permissible by theorem 8.12 
and exercise 8 (a), 4. 

Take any ¢ > 0. Since ¢i, ..., 6}, are uniformly continuous, there 
is a 6 > O such that, for j = 1,..., 7, 


|dj(u) — $(%)| < € whenever a < u,v < b and |u—v| < 6. (8.13) 
Also there is a dissection 9 of [a, b] such that 
AQ, $) > Aa(d)—e = AY) —«. 


We add, if necessary, points of division to 2 to form a dissection 
2* for which “(D*) < 6. Then 


A(D*, $) > AQ, ¢) > A(y)—«. (8.14) 
Let the points of division of 2* be 
A= ty < by <1. < ba < ty = BL 
For each j (j = 1, ..., ), the interval (t;_,, ¢;) contains a point 74, 
such that $40) - $te) = PON e—td. 
Therefore, by (8.13), for every ¢ in [t;_,, t], 
dit) -$(t-)-$O(-t)| < (4-ty) CU =1,....) 


19) - $I - 19’ Ol G@—-t-D| < ne(t;-t,1). (8.15) 
But, by exercise 6(a), 8, there is a u; in [t;_,, t,] such that 
fi lst = Weola49. 
Hence, by (8.15), 

i 
I9@)-9G-01-f" 11 
This holds for i = 1, ..., m. Adding these inequalities we obtain 

jae of 1s 
and therefore, by (8.14), 


A= [tel] < t1+mb—ae. | 


< ne(t,—t;_). 


< ne(b—a) 
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Exercises 8(a) 


1. Prove that the relation ~ between transits is an equivalence relation. 


2. A curve in R” is said to be smooth if one of its representations ¢ : [a, b] > R” 
is continuously differentiable and such that ¢’(t) + 0 in [a, b]. Show that not all 
representations of a smooth curve are continuously differentiable. (Contrast 
paths all of whose representations are piecewise continuously differentiable.) 


3. Show that, in the definition of the sum y,+...+7m of the curves y; (i = 1, ...,m) 
in R®, the choice of the representations ¢! : [/—1, ‘] > R" of y; is immaterial. 


4. Let ¢ on [a, b] be a representation of a curve y and let ue (a, b). Denote the 
arcs corresponding to the restrictions of ¢ to [a, u] and [u, 6] respectively by 
, and 72. Prove that y = ¥i+72. 
5. A rectifiable curve y has initial point p and end point q. Prove that 

AQ) > |p-al- 


6. Curves 7;, Y2; Ys in R® are given by the functions ¢* = (¢{, 0) (é = 1, 2, 3), all 
on [—1, 1], where 


it) = 4 
$i(t) = — sin }7t, 
rac 0 (t = 0), 
HO = oo (a/t) © < |t| < 1). 


Show that 71, 72, Ys have all the same trace and the same initial and end points, 
but that 7, 72 are rectifiable whereas 7, is not. Show also that A(y,) + A(7/2)- 


7. Let p, gq be coprime positive integers. Find the length of the epicycloid 
represented by ¢ = (44, ¢2) : [0, 2g7] > R*, where 


x(t) = (2+1) acost+a cos (2+1) t, ${) = (£+1) asin t+asin (21) $ 


(The curve is generated by the movement of a point fixed on a circle of radius a 
as this circle rolls on a fixed circle of radius (p/q)a.) 


8. Find the length of the curve in R* represented by ¢ on [0, 2], where 
H(t) = (tos t, tsin t,t) <tr < 2). 


9. Let ¢ on [a, 6] be a rectifiable transit in R". Prove that the function s on 
Leaal givenihy: 0 fort=a, 


BOI bos fora<t<b 


is continuous on [a, 5]. (Arc length is a continuous function of the ‘parameter’ f.) 


10. Let ¢ on [a, 4] be a transit in R". Show that ¢ is rectifiable if and only if 
lim A(Q, ¢) exists and that, if the limit does exist, then it is equal to A?(¢). 

Ma@)—>0 

(Cf. theorem 6.71 and exercise 6(g), 3.) 
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11. A space filling curve. The continuous function f: R! +> R'is defined as follows: 
Shas period 2, is even and f(t) = 0 for ¢ € [0, 4], f(t) = 1 for re [4, 1], fis linear 
in [4, 4]. The functions ¢, y : [0, 1] > R' are now defined by 


1 1 2 1 2n—2, 
f(t) = FO+RSG D+ +ZfB It) sang 


W(t) = FG+3fG%)+ ot RAGIN + anc 
Show that ¢ and y are continuous and that the curve represented by (¢, /) 
passes through every point of the square [0, 1] x [0, 1]. 
f , 7 €[0, 1], let = : 
GEE, 7 (0, 1 Je E = O' a a5..., 9 = 0' Ai fofy... 


in the binary scale (so that each «, or f; is 0 or 1). Let rT € [0, 1] be the number 
defined in the ternary scale by 


T = 0" (2ory)(2A;) (2g) (2A)... 
and show that £ = $(7), 7 = ¥(7).) 


8.2. Line integrals 


Let G be an open subset of R”(n > 1). We wish to define an 
integral of a continuous function f:G > R” along a rectifiable curve 
y in G. (We say that ‘a curve lies in a set’ when the trace of the curve 
is contained in that set.) 

Take a representation ¢:[a, b] > R” of y and a dissection Z of 
[ce 2), S\WER DY ae eal We ree 
When t;_, < 7; < t;, f{d(7,)} is a value of f on the trace of the arc 
corresponding to [¢;_,, ¢;] and we accordingly consider a sum 


EIGN. O- $6} = E AOE) - 8G) 
+t BAGG) Salb-D- B21) 
Each function ¢, is of bounded variation on [a, b] and, since fand ¢ 
are continuous, fo ¢ is continuous. Hence f,o ¢ € R(¢;; a, b) for 
i= 1,...,m, and, by exercise 6(g), 1, 
EMM) B49) > [Leo dra 


as (D2) -> 0. Thus the sum in (8.21) converges to 


3 [ie dab 


8.2] LINE INTEGRALS 253 


But we cannot define this expression to be the integral of f along y 
until we have shown that it is independent of the particular repre- 
sentation ¢ of y. 


Theorem 8.21. Let G be an open set in R” and suppose that the function 
f:G > R" is continuous. If y is a rectifiable curve in G and $:{a,b] > R", 
y:[c, d] > R” are both representations of y, then 


3 [eo dds, = 3 [ Gionar 
ata etaceiiiees se 


Proof. Since ¢ ~ y, there exists a continuous, strictly increasing 
function «:[a, b] > [c, d] such that a(a) = c, a(f) = dand¢ = you. 
By theorem 6.53, for each i, 


d 7) 'b 
[ictionate = ['howoadinea) = J’ Kio Adbu | 
We are now in a position to define the first of the two kinds of 
line integral. 
Definition. Let G be an open set in R" and suppose that the function 
f:G + R is continuous. If y is a rectifiable curve in G, then i Sf, the 
integral of f along y, is defined by 
n 'b 
[r- EJ viena. 6.22) 


where $:[a, b] > R" is any representation of y. 

When 7 is a path the sum on the right in (8.22) reduces to a single 
Riemann integral. For then ¢ is piecewise continuously differentiable 
and each ¢, is the difference of two increasing functions which are 
piecewise continuously differentiable (see exercise 6(h), 13). There- 
fore, by theorem 6.21 A, 


foieoad.e = [ie mova 
and fr- 3 ftom [ven.#. 
The form — [ {AO) BO +... +h OAD at 


of J (when y is a path) suggests the notation 
Y 


[ fran = [reom#ode 
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Therefore f Sis often denoted by 
iw 
[ (A@) dx, +... +fi(x)dx,). 


Mlustration. If y is the path in R® given by 


x=cost, y=sint (0 <1? < 2m) 
then 


2 2m 
J (x*ydx—x*dy) -{ (—cos?¢ sin*¢—cos*r)dt = -f cos*tdt = —7. 
Y 0 0 


The path ¥ is called the unit circle described in the positive (anti-clockwise) 
direction, A similar phrase may be used for the path given by 


x=atrcost, y=b+rsint (0 <t < 2n). 
Another frequently encountered path (in R") is one represented in the form 
x=pt(q-p)t O<t<1) 
This is what will be understood by the (straight line) segment from p to q. 


In the next theorem we collect the elementary properties of line 
integrals. 


Theorem 8.22. Let y, 1, V2 be rectifiable curves in an open subset G of 
R" and let the functions f, g:G > R” be continuous. Then 


Of rro-[r+f 
(ii) is f= ef FS (where c is a real number); 


iy | s--[ rs 
(iv) (ete f= im f+ fe St (when y, +72 is defined). 


Proof. Parts (i) and (ii) are obvious and (iii) follows from the 
identity (see theorem 6.53) 


J iato—maga—o = f'rigosap.o = - 16014500. 

To prove (iv), let d on [0, 1] and ¥ on [1, 2] be representations of 
1 and yz respectively. Then y,+y2 is represented by x on (0, 2], 
where (¢@ for 0<t<1, 


MOT ey for 1<1<2 
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2 rh 2 
[iiomdr = [Gio odbe+ [Vio Date | 
0 1 


and 


Integrals with respect to arc. The integrand is now real valued, not, 
as previously, vector valued. Given an open subset G of R”, a con- 
tinuous function f:G > R! and a rectifiable curve y in G, we define 
an integral of f with respect to the arc length of y. 

Let ¢:[a, b] > R” be a representation of y and define the increasing 
function s,:[a, b] > R* i 


0 for t= a, 
the () for a<t<b. 


For a dissection J of [a, b] into subintervals [to, ty], .--5 [4-15 t-] we 


consider the sum 
Pi {9(7,)} 5st) — Sold}, 


sy) = 


where t;-, < 7; < t;. Since fo ¢ is continuous and s, increases, this 


sum tends to " 
[ive sas, (8.23) 


as (FZ) > 0. 
Now, if w:[c,d]- R” is another representation of y, so that 
¢ = wo, where « satisfies the usual conditions, then 


AA (d) = AX) (a<t <b), 
ie, Sy = Syoa = SyO% 
Hence, as in the proof of theorem 8.21, 
[iro vay = [fo (oa)yalsy02) = [fo $)dby 


Thus the integrals (8.23) do not depend on the particular representa- 
tion ¢ of y and we can therefore denote them all by 


[ yas or J fora 


4 
When y is a path, then, by theorem 8.13, s, is an indefinite integral 
of ||¢’|| and so, by theorem 6.21B, 


[ya = [Fo ods, = [(Fo #) I. 
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Line integrals with respect to arc have the properties (i), (ii) and 
(iv) stated in theorem 8.22. However (iii) is replaced by 


(iii) rf fds = iS fds. 


For if ¢:[a, b] > R” is a representation of y, let d*:[—b, —a] > R" 
be the representation of —y defined by 

$*(t) = A(-) (-b<t< -a). 
Then clearly 5y(t1) = A(y) —5,(-1) 


and sof "tet @idsytd) = | “76(—0)} dN) -54(—9) 


-[*pe¢-aasy—9 


[reo 


In analysis, line integrals with respect to arc are comparatively 
unimportant. However, in mathematical physics, they have a part 
to play. (See exercises 8(b), 9 and 10.) 


Exercises 8 (5) 


1. Let G be an open subset of R" (n > 1); let y be a path in G and suppose that 
the functions f: G > R", g: G > R are continuous. Prove, without using the 
Stieltjes integral, that, if ¢: [a,b] > R" and yy: [c,d] R” are both represen- 


tations of y, then " a 
[wos -[vonw 


b a 
and [cools = [oly 
le 
2. Prove theorem 8.22 (iii) and the corresponding result for integrals with 
respect to arc, without making use of the Stieltjes integral, when y is a path. 
3. Let G be an open subset of R" and suppose that the function f: G > R” is 
continuous. Show that, if y is a rectifiable curve whose trace E lies in G, then 


| ih r\< fusia < MAQ), 


4. Let y be the triangular path in R* consisting of the segments from (0, 0) to 
(1, 0), from (1, 0) to (1, 1), and from (1, 1) to (0, 0). Evaluate 
k yidx+x*dy 
ly l+et+y” 


where M = sup |fO)]. 
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5. Given that a + 0, let y be the path in R* defined by 
x =a(l+cos2t), y=asin2t, z= 2acost (0<1< 2m). 


Show that the trace of y is the intersection of a (hollow) cylinder and a (hollow) 
sphere. Evaluate 


i {(y" + 2%) dxt (22+ x*) dy + (x? + y*) dz}. 
b 


6. The function /; R® > R® is defined by 
L(x, ¥, 2) = (92,0, x9); 


and ¥ is the (helical) path given by 
x=acost, y=bsint, z=ct (0<1t< 4). 
Evaluate [ f, and also [ f, where o is the segment from the initial point of y to 
Y o 
the end point of y. 
7. Let G be an open set in R". Let the function g: G-> R! be continuously 
differentiable and let the function /: G > R" be defined by 
f= grad g = (Dig, ..., Dug). 
Prove that, if the path y with initial point « and end point v lies in G, then 


it f= g(0)—s(u). 
yf 


(Thus if Shas the same value for all paths y in G which have the same initial 
Y 
and end points; the integral is independent of path (contrast 6).) 


8. Let D be an open connected set (region) in R". Prove that, if the func- 
tion f: D > R" is continuous and the line integral of f is independent of path, 
then there exists a continuously differentiable function g: D > R* such that 
f = grad g. 

(Thus, in view also of 7, in a region D the integral of a continuous function 
Sf: D > R" is independent of path if and only if f = grad g for some continuously 
differentiable function g: D > R'. By theorem 7.33, any two functions g differ by 
a constant. 


For the proof, take a fixed point ae Dand, for any x € D, define g(x) = | f, 


ye 
where ¥, is any path with initial point a and end point x; such paths exist, by 
theorem 3.32.) 


9. The ends of a uniform chain of length 2/ are held at the same height and a 
distance 2a(<2/) apart. It is known that, if the co-ordinate system is suitably 
chosen, the form of the chain is given by 

x=t, y=ccosh(t/c) (-a<t<a), 
where c is a constant. Show that c is uniquely determined by a and /. Show also 
that the centroid of the chain is a distance 

(1y(c? + P) — ac)/(21) 

below the ends. 


(The centroid (£;, ..., §,) of a curve y in R" is given by &,A(y) = f x; ds.) 
” 
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10, A wire is shaped in the form of the twisted cubic given by 
xa ys st, z= 3+" Omir< 2): 
Show that the total length of the wire is 10, and that the arc length between the 
origin and the point (x, y, z) is /2z. 
Find the moment of inertia of the wire about the y-axis, if its mass per unit 
length varies uniformly with arc length, from 0 at the origin to 1 at the other end. 
(If a wire is shaped as a curve y in R®, its moment of inertia about a straight 


line A is f up*ds, where p(x, y, z) is the mass per unit length at (x, y, z) and 
y 
P(x, y, z) is the distance of (x, y, z) from A.) 


8.3. Integration over intervals in R” 


We first dispose of some matters of terminology. By a closed 
interval in R” we mean a set J of the form 


[@y, 5.) x... x [@n, Bal, 
where a; < b; fori = 1,..., 2. The interval is cubical if 

by—a, =...= b,—Ay. 
The faces of J are the 2n sets 

LOC were xg leg sags, LCase. 5:0) ey a ae) 
The volume V(I) of Tis defined to be 
(by —4,)...(6, — an). 
If 2; is the dissection of the interval [a;, b,] given by 
a, = 8 < xt <...< xf] < xi = by, 


the dissection D = Y,x...xQ,, of I is the division of J into the 
r = 1y...r, Subintervals 
ES Gaab Ubanned bee chi h 
where 1 < j; < r,...5 1 <j, < ry. To define integration over J we 
now proceed in exactly the same way as in the one-dimensional case. 
Let the function f:/ -> R! be bounded. Given a dissection 


D=D,x...xD, 
of J into subintervals /,,..., J,, put 
m, = inf f(x), M, = sup f(x) 
for j = 1,...,7 and 
(F) = (9,f) = EZ mV), SB) = SO,f) = 3 MV). 
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These sums are, as usual, called ower and upper sums respectively. 

Further subdivision of J clearly increases the lower sum and dimin- 

ishes the upper sum. It follows as in §6.1 that, if and 9’ are any 

dissections of J, (2) < 9’). (8.31) 
We now write 


up 2 =[f into.) =| F 


and call the first expression the Jower integral and the second the 
upper integral of f over I. By (8.31), 


i f< Ie: (8.32) 


If there is equality in (8.32), fis said to be integrable over I and the 
common value of the upper and lower integrals, called the integral 
of f over J, is denoted by 


a or [fedae. 


An integral over an interval in R", where n > 1, may, for emphasis, 
be called a multiple integral. In R* and R® the corresponding terms 
are double integral and triple integral, respectively. These integrals 


are often written 
[fF or [fi fos navay 
I I 


and ff Re or ff PACs y, z)dxdydz. 


Multiple integrals and integrals in R' have the same elementary 
properties. The proofs of the following statements are easy adapta- 
tions of their analogues in chapter 6. 

(i) If f,g are integrable over J, then so are |f|, 1/f provided that 
inf f(x) > 0, af+bg (where a, b are real numbers) and /g; also 
we. 


fai < fiat 
and [ af+be) R af s+of s. 


(ii) Let 1, J, be intervals which have a face in common and are 
non-overlapping (i.e. have no common interior points) so that 
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1, U J, is an interval (distinct from J, and from J). Then, for any 
bounded function f on J, U 1, 


‘Naa Se HH and bis f= ie ref, i (GESE) 


Thus, if fis integrable over /, and over J, then f is integrable over 


It also follows that integrability over an interval implies integrability 
over any subinterval. 

The multi-dimensional form of Darboux’s theorem (6.71) is 
important. For a dissection Z of the interval / into subintervals 
I,...,1,, the mesh «(Z) of @ is the largest of the diameters 


PUL)s +++5 PU) 
(see exercise 3(d), 7). If now fis any bounded function on J, 


[f= Jims.) and [ f= lim 519.) 


M@)>0 MB)>0 


Now let f be a real-valued function on the interval K = JxJ of 
Rm" = RP, where I< R™ and J © R”. Suppose that, for every 
y €J, the function /(., y) is integrable over / and that the function 


¢ on J given by 
#0) = [fe ode 


is integrable over J. We then write 


[e-J, ([7oone) o 
es [af fosnae 


and call this expression a repeated (or iterated) integral. The same 
decomposition of K leads to the integral 


fae [ fos soa 
(if it exists). 
A repeated integral may involve any number of integrations. For 
instance if K = [ay bx... x [aps Bel, 
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one such integral is 
by by 
dr. f Ei cceeesln acre 
ap cn 


The next theorem and its corollaries serve to connect the integral 
of f over K and the associated repeated integrals; exercises 8(c), 6-9 
emphasize the distinctiveness of these integrals. 


Theorem 8.31. Let I, J be closed intervals in R™ and R” respectively 
and suppose that the function f:IxJ > R* is integrable over IxJ. 
Then the functions $, yv on J defined by 


40) =| fesnde, 10) = [fos sdax 


are integrable over J and 
[af soanas =f feo ndeay = [a] fos srde. (834 
He de IxJ J I 


Proof. Let 2 be any dissection of 1x J. Then 9 is of the form 
2D, xD,, where Dy, Pz are dissections of J and J into subintervals 
Ih, «51, and J,,...,J, respectively. The subintervals of IxJ are 
therefore I, x J; (k = 1,...,73/ = 1,..-, 5). 


Put My = sup f(x,y), M = sup #0) 
(x, Yel Rx It yet 


and, for any y €J, let 
MQ) = sup fe y)- 
Ele 
If y EJ, we have 
PAC > = MOV) 2 [ fos y)dx = WO) 
and, since this is true for all y €J;, 
DMaVl) > Nu 
Also V(I,xJ;) = VU,)V(J) and therefore 
r 8 8 r 
SE MuVexs) > EMM) > | H- 
k=1l=1 l=1 J 


This inequality holds for all dissections of Ix J. Hence 


Je [, = [ ay | fs ie 


Ixd 
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An argument similar to the one above shows that 
[of < [of fone. 
ET De Sieh T 


To prove the integrability of y and the right-hand identity in 
(8.34) we also use the inequalities 


[of founder < fa [pone < fa] ones 


for these then give 


eis [a] fe ax < fia] fond <f 


In the last theorem the functions ¢, y may, of course, be replaced 
by $*, *, where 


#0) =[ found, WG) =| fosndr @eD. 
We are therefore led to a sufficient condition for the invertibility 
of the order of integration in a repeated integral. 


Corollary 1. Let I, J be closed intervals in R” and R” respectively. If 
(i) the function f:I x J > R* is integrable, 


(ii) J J (x, y) dx exists for every y € J, 
I 
(iii) ‘i S(x, y)dy exists for every x <I, 
then ib oe ' cide wand dx i Hewat 
J rf I J 


exist and are equal. 

It is easily seen that every continuous function is integrable (cf. 
theorem 6.12(i)). The result of corollary 1 therefore certainly holds 
if fis continuous on J x J. (The existence of the two repeated integrals 


is also a consequence of the fact, to be proved in§8.7, that f I(x, .)dx 


and [ J(., y)dy are continuous on J and J respectively.) 
J 


Repeated application of corollary 1 shows that, for continuous 
functions, the process of multiple integration may be replaced by a 
number of single integrations. 
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Corollary 2. Let I = [a,, by)... [ans 5p] be an interval in R". If 
the function f:I > R* is continuous, then 


On by 
[fe cney Ha) ees -{ din f Xcess alesis 
I Gn CN 
Moreover the integral on the right may be replaced by 
Pin bi, 
Beige f PCy sses Xp) AXiyy 
Oy ay 


where (iy,.. +, in) is any permutation of (1, ..., 7). 
Another corollary is a relation between double integrals and line 
integrals. 


Corollary 3. (Green’s theorem for intervals in R*.) Let I be the 
interval [a, b] x [c, d] in R? and denote by @I the path determined by the 
four straight line segments from (a, ¢) to (b,c) to (b, d) to (a, d) to 
(a, c). If G is an open set containing I and the function 


f= AfyiG>R 


is continuously differentiable, then 
[fff @.s- Df. 
al ‘4 


Proof. In the statement of the corollary we have used our con- 
vention regarding the paths determined by straight line segments 
(see p. 254). Thus af = 71+7Y2—Ys—Ya Where 71 Ya, Ys, Ys may be 
represented by ‘ : 

x=ty=c @a<t<)b), x=by=t (c<t<d, 
< 


t<d), 
respectively. We now have, by corollary 2 and exercise 6(h), 10, 


ff, an = [fa [i .Ate nae 
= fine. vdy-f Sela, y)dy = i) . f= Z fs 


< 
S 


x=ty=d (a<t<b, x=ay=t (c 


and similarly ff, Df, = f ii nth | 
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Exercises 8(c) 


1. The real-valued function fon [a, 6] x [c,d](< R®) isincreasing in each variable, 
ie., for each y €[e, d], f(x, y) increases with x and, for each x [a, b], f(x, ») 
increases with y. Prove that f is integrable over [a, b]x[c,d] (cf. theorem 
6,12 (ii)). Extend this result to functions on intervals in R"(n = 1, 2, ...). 


2. Let J be a closed interval in R™ and suppose that the function f: > R° is 
integrable over J. Define the function ¢: x R" > R' by 


G(x, ») = f(x) el ye R"). 


Prove that ¢ is integrable over every interval K = [x Jin R™", 
Suppose, in addition, that the function g: J > R' is integrable and that the 
function h: K + R' is defined by 


A(x, y) = f(x)e(y) (xel, yeJ). 
Show that A is integrable over K and that 


Je+=({(L-)- 


3. Prove that, if a,b > 0, c + 0 and J = [0, a] x (0, 4], then 


it dxdy a Ie. aa ab 
r(P+y +t ¢ cy(a?+b?+c%)* 


4, If Zis the interval [—1, 2]x[—1, 0] x [0, 2] of R*, show that 
Zz 2 
I=) dxdydz = 9 log 6. 


a1 
ik dy [va-y cos*x)dx (0 < a < 4m). 
lo Jo 
6. The function f on J = [0, 1] x [0, 1](< R®) is defined by 


5. Evaluate 


0 if at least one of x, y is irrational, 


fey = ie if y is rational and x = pla, 


where p,q are coprime integers and g > 0. Prove that 


‘1 1 
[fosndrdy and [fo [ sender 
i @ 0 0 


exist and are equal, but that " 1 
f dxf f(x, y)dy 


Find a function A on J such that f h exists, but neither of the associated 
I 


does not exist. 


repeated integrals exists. 
7. Define the function f on J = [0,7] x [0, 1] by 
cosx if y is rational, 


fy) = 


0 if y is irrational. 
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1 
Show that il dy f fle de 


exists, but that = 1 
[fos needy and [a | S(x, ydy 
0 


do not exist. 


8. Let (1, Po, Ps, --.) be the sequence of primes (2, 3, 5, ...); let 


na (3) 


co 
and let P=UP,. 
k=l 


mn= 1, ws Pa=1} 


Show that the set P is dense in [0, 1] x [0, 1], but that any line parallel to the axes 
contains no more than a finite number of points of P. 
Define the function f: J = [0, 1] x [0, 1] > R' by 


Hash 1 forxeP, 
Y= \0 for xeI-P. 
a1 1 aT 1 
Show that fief S(x, y)dy and J | S (x, y)dx 
0 Jo 


exist and are both 0, but that f f does not exist. 
r 


9. The function /: [0, 1] x [0, 1] + R? is defined by 
lj if0<x<y<l, 
fy) = {-1 if0<y<x<1, 
0 otherwise. 
Prove that 1 I ; ‘ 
‘ dy { fe, y)dx and f a [fos y)dy 


both exist, but are unequal. (By theorem 8.31, f cannot be integrable over 
[0, 1] x [0, 1]; in fact, f is unbounded near the axes.) 


8.4. Integration over arbitrary bounded sets in R” 


We often wish to integrate functions over sets which are not 
intervals. There is a simple device for doing this (which applies to R! 
as well as to multi-dimensional Euclidean spaces), 

Let E be a bounded subset of R” and suppose that the function 
J: E > R' is bounded. Define the function fg: R" > R! by 


_ {f@) if xe£, 
fas) = { 0 if xek. 
It then follows easily from (8.33) (see exercise 8(d), 1) that 


i) fe and ite 
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have the same values for all closed intervals J containing E. We call 
these two numbers the lower integral and the upper integral of f over 


E, denoting them by = 
[ f and | f 
JE E 


respectively. If the upper and lower integrals are equal, their common 
value is called the integral of f over £; it is written 


Ly 


and fis said to be integrable over E£. 

When f = 1, fy is the indicator (or characteristic) function xz (first 
mentioned in §6.8). The inner content c(£) of E and the outer 
content ¢c(£) are defined by 


a= [, 1, Ae)= ic 1. 


If c(E) = c(E), the common value is called the content of £ and is 
denoted by c(E£). (Cf. §6.8.) Clearly, the content of a closed interval 
is its volume. It is also easy to verify that the content of an open 


ica (a, By) x 21. % (dy, by) 


is (b,—a,).. .(b, —a,), the content (or volume) of its closure (exercise 
8(d), 2). For other elementary results on integration and content see 
exercises 8(d), 3-7. 

The theorem below generalizes theorem 6.81. 


Theorem 8.41. 

(i) The bounded set E in R" has zero content if and only if, given 
€ > 0, there is a finite number of closed intervals (or a finite number of 
open intervals) which cover E and whose total content is less than e. 

(ii) The statement (i) is true when all intervals are restricted to be 
cubical. 


Proof. We prove (i) and (ii) at the same time. 
First suppose that c(E) = 0. Let K be any cubical interval con- 


taining E. Since [ Nz = 0, Darboux’s theorem shows that there is a 
K 


dissection 9 of K into cubical subintervals such that S(D, xz) < ¢; 
and S(Q, xz) is the sum of the contents of the closed cubical sub- 
intervals K,, ..., K, which contain points of E. 
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Each K; may be replaced by a larger open cubical interval so that 
the content of the open intervals is still less than e. 

Now suppose that, given ¢ > 0, there is a finite number of open 
intervals J, covering E and of total content less than ¢. Let J be a 
closed interval containing all the J;, and form a dissection J of J into 
subintervals J,, ..., J, by producing the faces of the J,,. (The process 
for n = 2 is illustrated in the figure; the intervals J, are shaded.) 


Wa 


Y 
W 


Since the J; in J— UJ, do not contain points of E and the total content 
of the rest is less than e, S(Z, vz) < ¢. This holds for all « > 0 and 


sof Xn = 0. 


If we start with closed intervals, we may enlarge them slightly into 
open ones and then proceed as before. | 


We have previously noted that continuous functions are integrable. 
This result can be significantly improved. 


Theorem 8.42. If f is bounded on the closed interval I and the set of 
points of discontinuity of f has zero content, then f is integrable over I. 


The proof, in which the points of discontinuity are covered by open 
intervals of small content, is easily adapted from the proof of the 
analogous theorem 6.82. 

An informal interpretation of the next theorem is that the sets 
with content are those whose edges are not too blurred. 


Theorem 8.43. A bounded set in R” has content if and only if its 
frontier has zero content. 
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Proof. Let E be a bounded set in R” and denote its frontier by F. 
The function yy is continuous on the open set F’. Hence, by theorem 
8.42, if c(F) = 0, then xz is integrable over every interval containing 
E, i.e. c(E) exists. 

Now suppose that F does not have zero content, so that 


[t-e>0 
F 


If J is an interval containing F, then S(9,x,) > a for every dis- 
section F of J. Take J to be a cubical interval whose frontier lies in 
E' and take J to be a dissection of J into congruent cubical sub- 
intervals J, ..., J}. 

Let €€ F. If € isin J, and in no other subinterval, then 


sup Xz(x)—inf y~(x) = 1. (8.41) 
wel, wel, 


If, however, £ is on the frontier of two or more of the /,, then (8.41) 
need hold for no more than one of these. Since at most 2” of the Jj, 
contain any given point of F, (8.41) holds for at least a fraction 1/2” 
of the J, meeting F. Hence 


S(D, Xz) - (PD, Xz) 2 a/2” 
and so, by Darboux’s theorem, 


J xe-f Xz > a/2" > 0. | 
Fe AE: 


A combination of theorems 8.42 and 8.43 gives a particularly 
useful condition for integrability. 


Theorem 8.44, Let E be a subset of R" which has content. If the 
bounded function f:E > R' is continuous except on a set of zero 
content, then f is integrable over E. 


Proof. Let X be the subset of E on which f is discontinuous. Then 
Jp is continuous on (E)’ and on E°— X. Hence, if F is the frontier 
of E, all discontinuities of fy; lie in the set XU F which has zero 
content. It follows from theorem 8.42 that /; is integrable over every 
interval containing E£. | 


Theorem 8.45. The trace of any rectifiable curve (in R") has zero 
content. 


Proof. Let the rectifiable curve y have trace I and length A. If 
y:[a, b] > R” is a representation of y, the function s on [a, 6] given 
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by s(t) = AL, (¥) is continuous (exercise 8(a), 9). Hence there are 
points Ce ay <i Se Sia 

such that s(u’)—s(W) = Afr (GG =1,..., 7). 

Now, for each j, let K; be the cubical interval with centre y(u’) and 
sides of length 2A/r. Then, by exercise 8(a), 5; the K, cover T' and 


their total content is /5)\» (2a) _ (2A) 
of ek eer 


which may be made arbitrarily small by taking r sufficiently large. | 


The previous theorem is mainly useful in R?; in higher dimensional 
spaces the sets of points with which it deals are not ‘large’ enough. 

Let m,n be integers such that 1 < m <n. A surface in R” is 
defined to be a continuously differentiable function ¥:G —> R", 
where G is an open subset of R”, Also, if H is any compact subset of 
G, we call the restriction of y to H a surface section and the set Y/(H) 
its trace. A continuously differentiable transit is a surface section for 
which m = 1 and H is a finite closed interval. (The notes at the end 
of this chapter include some remarks about surfaces.) 


Lemma. Let G be an open subset of R" and suppose that the function 
¢:G — R® is continuously differentiable. If the set E has zero content 
and E ¢ G, then the set $(E) also has zero content. 


Proof. By theorem 8.43, E has zero content. It is enough to prove 
that ¢(E) has zero content. Given ¢ > 0, there are closed cubical 
intervals J, ..., J, which cover E and the total content of which is 
less than ¢. Since the distance between the compact set £ and the 
closed set G’ is positive (exercise 3(f), 14), we may suppose that each 
I, is contained in G. Put 3 


UL, =H. 
j=l 
The function Dé:G-—>L(R", R”) is continuous and therefore 
bounded on the compact set H. Let 
sup | Dd) = M. 
Then, by theorem 7.31, 
|@)-40)| < M\|x-y 


whenever x,y €J; (j= 1,...,7). Hence, if the sides of J, are of 
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length s,, A(/;) can be enclosed in a cubical interval whose sides are 
of length (M/n)s,. Thus ¢(E) can be covered by a finite number of 
cubical intervals whose total content is less than (M,/n)"e. | 


Theorem 8.46, The trace of a surface section in R"(n > 1) has zero 
content, 


Proof. Let the trace in question be ¥(H)(< R"), where y is a 
continuously differentiable function on the open set G in R™, where 
1 < m < nand His a compact subset of G. The set 


H* = {(X4, «045 ins 0, --+5 0) [Oras ---) Xm) © A} 


in R" is clearly compact and has zero content. Also the function y/* 
on the open subset G x R"~” of R” given by 


Wry woe Xn) = Wry «0-9 Xm) 


is, by consideration of its partial derivatives, seen to be continuously 
differentiable. Since Y(H) = ¥*(H*), it therefore follows from the 
lemma that /(H) has zero content. | 


We now introduce a convenient phrase. Let E be a subset of R” 
and suppose that every point of E either does or does not possess a 
certain property P. If P holds for all points of E except for those in a 
set of zero content, we shall say that P holds nearly everywhere in E 
(or, for nearly all points of E). The n-dimensional form of theorem 
6.83 may then be stated as follows. 


Theorem 8.47. Suppose that f and g are bounded on a bounded subset 
E of R" and that f(x) = g(x) nearly everywhere in E. Then either both 
J and g are integrable over E or neither is integrable; and, if f, g are 


int egrable, 
[.f i) 
D E 


The proof is similar to that of theorem 6.83. The theorem shows, 
as was pointed out in similar circumstances in §6.8, that the process 
of integration over a‘given set does not require the integrand to be 
defined everywhere on that set—nearly everywhere is enough. This 
remark leads to a useful corollary of theorem 8.31. 
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Theorem 8.48. Let I, J be closed intervals in R™ and R" respectively. 
If 
(i) the function f:Ix J > R° is integrable, and 


(ii) A(y) = be F(x, y) dx exists for nearly all y € J, 
then ¢ is integrable over J and 


i. dy | fos y)dx = re y)dxdy. 


This theorem is the basis for evaluating multiple integrals over 
sets which need not be intervals. We illustrate the method with a 
simple example. 

Let the functions u, v:[a, b] > R! be such that u(x) < v(x) for 
a<x <b and let E be the set of points (x, y) in R® such that 
a<x < bandu(x) < y < v(x). If, now, f:E > R’ is integrable and 


"o(ae) 
[Efe day 
u(x) 
exists for nearly every x in [a, b], then 
'b w(x) 
J, feo »rdxay = [ax ["" fx »)dy 
E a u(z) 


The identity follows from theorem 8.48 and the observation that, 
if [a, b] x [c, d] > E, then 


'd (a) 
fi fel voy = [fon vba. 


In particular, take E to be the triangle with vertices (0, 0), (0, 1), 
(1, 1) and let f:E > R! be given by 


S(%, y) = 408 +2y 41). 


Then E£ has content, since its frontier is the trace of a rectifiable curve 
(theorems 8.43, 8.45). Also f is continuous on £. Therefore f is 


‘1 

integrable over E (theorem 8.44) and { J (x, y)dy exists for every 
x 

xe [0, 1]. Thus 


4 Seat 
L@rprp®? [.@|, arya? 


-{, (ermal er 1-575. 
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We also have 


Ss tem ak eee 
[Rees Boe {, DWecwresy, \ 


but the evaluation of the repeated integral on the right is tedious. 


Exercises 8(d) iz 
1, The set E in_R" is bounded. Prove that, if the function f: E > R' is bounded, 


then | fg and J Sz have the same values for all closed intervals J containing E. 
I I 


2. Prove that —c{(@, by) x... * (Gn, bn)} = (b61—y)...(On— Gn). 
3. Show that, if E is a subset of R” such that c(E) = 0, then, for any bounded 
function f: E > R', i f exists and is 0, 

E 
4, The function f is integrable over a set E in R". ()'Show that f need not be 
integrable over every subset of E, but that f is integrable over every subset with 


content. (ii) Show that, if f is integrable over the subset X of E, then fis also 
integrable over E— X. 


5. Let E,, E, be bounded sets in R" and suppose that the function f: BE, U E, > R* 
is non-negative and integrable over E, and over E;. Use the method of exercise 
6(h), 5 to prove that fis integrable over E, U E, and over E,N E, and that 


| es ed A 
'H, Ey En By Ey By 
Prove also that / is integrable over E,—E, and that 


feat f oe Tnon! 


Deduce that both results hold without the restriction that fis non-negative. 


6. Let the function / be bounded on the (bounded) set Z in R"; and suppose that 
there exists a sequence (X;,) of subsets of E such that fis integrable over each set 
E-—X,, and C(X;) > 0 as k + 00. Prove that fis integrable over E and that 


hic ri [ Saher 


7. The mean value theorem. The set E in R" has content and the function 
f: E> R'is integrable over E. Prove that there is a number / between the upper 
and lower bounds of f on £ such that 


ie = nel). 


If Eis also closed and connected and / is continuous, prove that there is a point 
£ in E such that « = f(é). 
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8. Let J be the closed interval 

[ay bi) x... ¥ [ans Bnd 
in R" and let the function f: J > R! be integrable. For x = (x, ..., Xn) € J, put 

To = [A1, ¥1) X «+ * [Any Xn 

Prove that the function F: J-> R* defined by 

F(x) = i f @weD 
is continuous. (F(x) is defined for all x € J, since each J, has content; if x; = a; 
for some i, then c(J,) = 0.) 


9, Prove that the content of an open or closed disc of radius r is mr*. (The 
content of an n-dimensional ball will be found in exercise 8(/), 12.) 


10. (i) Let I be a closed interval in R" and suppose that the function f: J > R 
is integrable over J, Show that the set 


S = {ty 000 Xns Xnsa)| ay «oes Xn) EL, Xaver = Lay «+5 Xn)} 


in R" has zero content. 
(ii) Given a set E in R" and a non-negative function f: E > R’, the set 


D = (Cay oes Xny Xng)| Cts «+9 Xn) CE, O < Xing < fOr, «++ Xn} 


in R"* is called the ordinate set of f on E. Show that, if E has content and fis 
continuous (as well as non-negative), then D has content and 


e(D) = fe 


(Show that xp is nearly everywhere continuous.) 
11. Let a,b > O and let the function f be given by 


fe») = (8)" Gane Ry + -D. 


Find the contents of the ordinate sets (see 10) of f on (i) the closed interval 
[—a, a] x [0, 5] and (ii) the set 


{(x, ») |y > 0, x?/a*+y*/b® < 1}. 
12. Show that, if S is the square with vertices (1, 0), (0, 1), (—1, 0), (0, —1), then 


x-ytl Le 
(2oeo = log 3. 


1 1 
j, of e-wedx, 
0 v 


(Note that the integrand is not defined on the y-axis.) 


14. Evaluate f Peerteetvde 
m(xty+zt1)” 


where E = {(x, y, z)|x > 0,» 2 0,z 2 0,x+y+z < 1}. 


13. Evaluate 
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15. The real function f on [a, 5] is integrable and, for n = 1, 2, ..., the functions 
J, on [a, b] are defined by 


HOV 


‘ze 
@-D! [ (x-1yrf(@dt (asx <b). 


Prove that ig? = fai); 


so that f, is the nth repeated integral of f, i.e. 


fi) = f ” dt. ty [rend 


8.5. Differentiation and integration 


The simplicity of the space R' sometimes fails to reveal the ideas 
underlying familiar aspects of real function theory. We saw this in 
chapters 3 and 7; another instance occurs in this section where we 
wish to extend the two relations 


EL fA7L0) and [7 = 10)-L@ 


(which hold under suitable conditions) to multiple integration. To do 
so we have to introduce derivatives of set functions. 

A set function is simply a real-valued function whose domain is a 
class of sets. For instance, if E is a set in R", @, is the class of subsets 
of E with content and f: E > R’ is a function integrable over E, a set 
function 0: @z + R? is given (see exercise 8(d) 4), by 


of) =[ f (Xe). 


Definition, Let E be a subset of R" and let o be a set function on @y. 
Then o is said to be differentiable at the interior point x of E and to 
have the derivative Do(x) (a real number) if, given e > 0, there is a 
& > 0 such that o(I,) 


cz) 


for every cubical interval I,, which contains x and has diameter p(I,) 
less than 6. 

Suppose that U is a subset of E at all points of which o is differ- 
entiable. Then o is said to be uniformly differentiable on U if, given 
€ > 0, there is a 8 >'0 such that (8.51) holds whenever x € U and I, 
is a cubical interval containing x with diameter p(I,) < 6. 

It is easy to see that the derivative of a set function is unique. For 


— Do(x) 


<e (8.51) 
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set functions in R! there is a simple connection with ordinary deriva- 
tives. (See exercise 8(e), 1.) The notion of uniform differentiability 
has not been used before. 


Theorem 8.51. Suppose that E is a subset of R" and that the function 
Jf:E > R' is integrable over E. If x is an interior point of E and f is 
continuous at x, then o, is differentiable at x and Dox) = f(x). 

The proof is very similar to that of theorem 7.62 of C1. (See also 
exercise 6(a), 10.) 


Theorem 8,52. Let G be an open subset of R" and suppose that the 
Junction f:G + R' is continuous. If H is a compact subset of G, then 
o, is uniformly differentiable on H (and Do,(x) = f(x) for x € H). 

Proof. The compact set H and the closed set G’ are disjoint and so 
p(H, G') = 2a > 0 (exercise 3(f), 14). Let 


K = UB(x; 2). 
zeH 
Then K is a compact subset of G and so f is uniformly continuous 
on K. Thus, given e > 0, there is a 6 > 0 such that 
|f@—-f@]| <¢€ whenever u,veK and |lu—vl| < 6. 

Let xe H. If J, is any cubical interval containing x such that 

p(,) < min (a, 6), then J, < K and so, for ye J,, 
F(x) -€ < f() < fQ@) +e. 

It follows that 


(fx) del) < f F< (FO)+8) lt), 


o (Ix) | 
—f(x)| < ¢ 
ts -f)| < «| 
The last theorem has a partial converse which is particularly 
important. To state it we need one more definition. 


Definition. Let E be a subset of R". The set function o:@y > R° is 
said to be additive if, whenever X, Y € @z and X 1 Y has zero content, 
o(Xu Y) = o(X)+0(Y). 

When the function f: E > R? is integrable over E, then, by exercises 
8(d), 3 and 5, the set function o; is additive. 

Note that two closed intervals J, J are such that c(Jn J) = 0 if and 
only if any common points of J and J are frontier points of both. 
Such intervals we have called non-overlapping. 


ie. 
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Theorem 8.53. Let G be an open subset of R" and let o be a non- 
negative, additive set function on €. Suppose that H is a compact sub- 
set of G and @ is uniformly differentiable on H with derivative f. Then 
the function f: H -> R* is continuous and, if E is a set with content such 


that E < H°, 
o(E) = is (8.52) 


Proof. 

(i) We first show that, the relation (8.52) holds when E is a closed 
cubical interval J in H°. For this we do not need the hypothesis that 
@ is non-negative. 

Given ¢ > 0, there is a 6 > O such that 


ee 
ez) 
whenever x € H and I, is a cubical interval containing x with p(J,) < 6. 
Let u, ve H be such that |jw—v|| < 45/(2,/n). At least one of the 2” 
cubical intervals with diameter 46 and one vertex at u contains v also. 
If J is such an interval, 
o(L 
D:D _ pe) 


[70 =f < | fy -F9| + | 
Therefore f is (uniformly) continuous on H and the set function 


07:6 yo > R' exists. 
By theorem 8.52, a, is uniformly differentiable on J and 


Do,(x) = f(x). 


Hence the set function T=0-O, 


-f¢)| <eé 


aD < 26, 


is uniformly differentiable on J and D7(x) = 0. Thus, given e’ > 0, 
there is a 6’ > 0 such that 

10) 
el) 
whenever J is a closed cubical interval contained in J and with 
diameter p(/) < 6’. Divide J into non-overlapping cubical intervals 
I,, ..., 1, each with diameter less than 6’. Since oy is additive, so is 
7 and we have 


IrW)| = Pac) < e Seth) = e'e(J). 


<eé 


But this inequality holds for all e’ > 0 and so 7(/J) = 0, i.e. 
o(J) = o,(J). 
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(ii) Now let E£ be any set with content and with closure E in H°. 
Since p(E, (H®)’) > 0, given ¢, there are sets U, V, both finite unions 
of non-overlapping cubical intervals, such that 


{0 Mahe Ee) hls ko (8.53) 
and c(V)-e€ < c(E) < c(U)+e, 
or, by exercises 8(d), 4 and 5, 
c(E-—U) <e, c(V-E) <e. 
If ~ = sup f(x), we then have 
weH 


ft ~Set-Seo? > Jef" (8.54) 
il [,t< [ote (8.55) 


As @ is non-negative and additive, we have, by (8.53), 


o(U) < o(E) < o(V) 
Endiniview icant f SS 78) < J uh 
By (8.54) and (8.55) we now obtain 
[fre < 0) < [fue 


and these inequalities hold for all positive e. | 


Exercises 8(e) 


1. Let (a, 5) be an open interval in R' and suppose that the functions /: (a, 6) > R? 
and 7: @q,») > R' are connected by the relation 


S(%)—f%) = (1, x2) (a < x1 < X < 5). 


Prove that ¢ is differentiable at the point x of (a, b) if and only if fis differentiable 
at x and that, when the two functions are differentiable, 


Do(x) = f(x). 


2. Show that, if Eis a subset of R”, o is an additive set function on @z and X is 
a subset of E which has zero content, then o(X) = 0. 
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8.6. Transformation of integrals 

Much of the theory of multiple integration is a straight-forward 
extension of the corresponding one-dimensional theory. The most 
conspicuous exception is the change of variable formula 


[nf J,vonlel 


(in which J¢ is the Jacobian of 4). Whereas the proofs of correspond- 
ing results in R! (theorem 6.92 and exercise 6(i), 1) are relatively 
simple, our task now is long and, in places, difficult. The reason for 
this difference is that a continuous function transforms intervals into 
intervals in R', but not in higher dimensions. We begin by consider- 
ing the effect of a linear transformation on the content of a paral- 
lelepiped. 

A parallelepiped P in R” is determined by the n pairs of hyper- 
planes on which its faces lie. If these hyperplanes are B,, Cy, ..., 
By, Cn, Where B;, C; are given by 


i ° 
Ay Xt... +inXn = {. Of< oy T= ieee 
4 


then € = (&,,..., &,) € P if and only if 
By Sag bichon hate scp (GE =ileemy (8.61) 


Since the faces of P have zero content (by theorem 8.46), P has 
content. Also, using the inequalities (8.61), we see that, if ¥ is an 
n—m dimensional subspace of the form 


Xz, = constant,..., x;,, = constant, 


then points of Y which are interior (exterior) points of P in R® are 
also interior (exterior) points of Pn X in X. The frontier of Pn X 
(clearly a bounded subset of X) therefore lies on the sets 


Ben Xo Cgineke Le se gitt) 
which are hyperplanes in X¥. Hence Pn X has (n—m dimensional) 
content in X. It follows from theorem 8.31 that c(P) is given by 


‘dn nh 
c(P) -{ Xp -{ dy...f NeA%, +25. Xp) Xa (8.62) 
I Pn Dy 


where I = [p,, q:] x... x [Pns Yn] is any interval containing P. More- 
over the order of the integrations in (8.62) is immaterial. 


8.6] TRANSFORMATION OF INTEGRALS 279 


The inequalities (8.61) also show that, if A is a bijective linear 
function on R” to R”, then A(P) is again a parallelepiped. 


Lemma 1. If P is a parallelepiped in R” and 2X is a linear function 
NOE) = eR), (8.63) 
where J is the Jacobian (i.e. the determinant) of X. 


Proof. If J = 0, then the rows of the matrix of A are linearly 
dependent. Thus A(R”) is contained in a hyperplane A of R” (given 
by an equation a,x,+...+a,X, = 0). Hence A(P) is a bounded 
subset of A and so has zero content. This case will not, actually, 
be used in the sequel. 

Now suppose that J + 0. We first write (8.63) in the form 


f_xuer = if xe (8.64) 
EK I 


where J, K are any intervals which contain P and A(P) respectively. 
Put Q = A(P). Then, since J + 0 and therefore A is bijective, (8.64) 


may be written as 
if ym vif xo a. (8.65) 


Next we note that A is the composition of elementary linear 
functions y, a, 7; (i = 1,...,2—1), where 
P(Xy +029 Xn) = (Kx, Xa, «009 Xn) (kK + 0), 
(X45 v045 Xp) = (Xp + Xay Xp «019 Xn)s 
Tey -05 Xgy Hgzts «2s Xn) = (ay «os Neat» Nis «+09 Xn)> 
(It is well known that a non-singular matrix is the product of 
elementary matrices—see, for instance, L. Mirsky, Linear Algebra, 
chapter vi.) Since the Jacobian of the composition of two (linear) 
functions is the product of their Jacobians, it is sufficient to prove 
(8.65) for the cases A = 4, a, 7;. The Jacobians of these functions are 
k, 1 and —1 respectively. 
(i) A = yw. Take 
I = [-a,a]x...x[-a,a], K =[-|kla, |k|a]x...x[-a, a], 
where a is so large that ] > P and K > Q. Then, by theorem 6.92, 


a a 
\k| if XQoe = elf om Xolkx, ves Xp)dxy 


a ka 1 
= ean ar Xn) E dx, = i Xe 
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(ii) A = a. Let 
I = [-a, a]x[-5, b]x...x[-}, d), 
K = [-a+b, a—b]x[-b, b]x...x[-—5, 5), 
where 7 > Pand K > Q. Then 


b ‘a 
i Xqoe = i eee NQ(%1 + Xp) Xa, «009 Xp)AXy 
- -a 
‘b a+2, 
= \ dXp, | NeXt Xa »++9 Xn) aX 
—b —a+z, 


b ‘a—b 
= fo ataeel ole Xap ons Xp) Ay = dis Xe 


since [—a+ Xx, a+X,] > [—a+b, a—b] when x, €[—5, 4). 
(iii) A = 7;. If I = K = [-a,a]x...x[-a, a], where I> P, Q, 
then’ 


in XQ; 


a a a a 
= ie an aeag Xegas Mie eesp aaa 


a a a ‘a 
= [te fs dx, regal Xo ves Nagas Xpy o0y Xp Oy 


= [ Xa 


since the order in the repeated integral may be changed. | 


In the next lemma we no longer confine ourselves to linear trans- 
formations. We denote by I(x; 7) the closed ‘cubical’ interval with 
centre x and sides of length 27. 


Lemma 2. Let G be an open subset of R” and suppose that the function 
¢:G— R” is continuously differentiable, injective and such that 
Jd(x) + 0 for xeG. 

(i) If the set E has content and E < G, then the set ¢(E) also has 
content. 

(ii) If H is a compact subset of G, then, as y +0, 


@ P{p(Ix; 9))} > 0 
cf p(x; ))} 
and (b) “de Dy + |Jd(x)| 


uniformly for x € H. 
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Proof. 

(i) Since the set E is bounded (it has content), E is compact and so, 
by theore n 3.64, $(E) is compact. Hence the subset 4(£) of ¢(E) is 
bounded and, by theorem 8.43 and the lemma of §8.4, to prove that 
¢(E) has content it is sufficient to prove that fr ¢(E) = ¢(fr E). 

We first note that the condition J¢(x) + 0 ensures that the subset 
X of G is open if and only if ¢(X) is open. (See theorems 3.23 and 
7.52.) In particular, ¢(G) is open. 

Now let x e fr E. Put y = (x) and let B,(< ¢(G)) be an open ball 
with centre y. Then ¢—(B,) is an open set containing x and, since 
x is a frontier point of E, é-(B,) contains points of E and of G—E. 
The injectiveness of ¢ then ensures that B, contains points of ¢(E) 
and of 4(G) - ¢(E) = ¢(G—-E). Hence ¢(x) = ye fr d(Z) and so 
¢(fr E) < fr #(E). The proof that fr ¢(£) < (fr E) is similar. 

(ii) (@) When I(x; 9) < G, 


POU: M)} < 2, sup id) — 9) (8.66) 
and, for ue I(x; 7), ||x—ul| < (/n)y. Hence (see exercise 7(c), 4(i)) 
the right-hand side of (8.66) tends to 0 as tends to 0, uniformly 
for xe H. 


(b) By the inverse function theorem 7.51, ¢-* is continuously 
differentiable on the set ¢(G) and 


Dé-(9(x)) = [Dd(x). 
Also, by theorem 3.64, ¢(H) is compact and so || Dé-(y)|| is bounded 
Torye Es let sup |Dg-4G}] = k: 
veg) 


If therefore Dé(x) = A,, Dé-(¢(x)) = Az! and 
|Az*@o|| < Alu) 

whenever x € H and u € R”. The idea of the proof is that, for small 7), 
the image of I(x;7) under the transformation y, = Az'o¢@ is, 
approximately, I(y,(x); 7). 

Take ¢ such that 0 < e < I/(k,/n). By exercise 7(c), 4(ii), there 
is ad > O such that 

|P(x+h)—9(x)-A,(h)|| < €l|Al] 
for x € H and |\A\| < 6. Then, for such x and h, 
Az A(x +h) — $C) -A,(A)}]| < kel Al, 

ies |\Velx+h) —Yra(x)—Al| < kellAl). (8.67) 
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Let xe H and let 7 be such that 0 < Jy < 6. It was shown in 
the proof of (i) that 


fr v(x; 0) = Ye(fr I(x; )). 


Now, if x+hefr (x; 7), then 4 < |All < Jny. Hence, by (8.67), 
points on the frontier of y/,(1(x; 7)) lie within a distance ke /ny of the 
frontier of 1(y,(x); 7). It follows (see exercise 8(f), 1) that 


M = I(Ye(x); 9 —keyny) | Y(U(x3 1) | Mx); 9+ keyny) = N. 


Since A,,0 y;, = ¢, 
AMM) = d(x; )) = ACN). 


By (i), ¢(1(x; 7)) has content. Then, since JA, = J¢(x), lemma 1 gives 
|JA(x)|(1 — ken)" (2)” < cf p(x; 0))} < |JP(x)|(1 + ken)” (27)”, 


. e ef p(s 7)} n 
ie, I —keyn)"\J6Q)| < Ca ayy < + keva)"|J6O)|- | 


Theorem 8.61. Let G be an open set in R” and let E be a set with 
content such that E < G. Suppose also that the function §:G —> R” 
is continuously differentiable and injective and that Jd(x) + 0 nearly 
everywhere in G. If the function f:¢(E) > R® is continuous, then the 


integrals 
Fit amt f,fooivel 


exist and are equal. 
In the classical notation, according to which the Jacobian J¢ of 
the transformation x = Q(t) (or x; = O,(ty,...5 t,) (i = 1,..., 0) is 


denoted by Arta inuate) 


Cea) 


the relation to be proved is written 
Ayn Sq) tiy = JSC  } 
o(E) E 


Proof. 

(i) First suppose that the set Q on which Jé(x) = 0 is empty. 

In view of Tietze’s extension theorem (5.52) we may suppose that 
f is defined and continuous not only on the compact set A(£), but 
on the whole of G. Moreover f may be expressed in the form 


St =f*-f-, where ft = 4(|f|+/),f- = 4(|f|—f) and these functions 


A(X, +++» Xn) 
Blan agt,) | tat 
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are non-negative and continuous. We shall therefore assume from 
now on that f is also non-negative. 

If the set ¥ has content and XY < G, then by lemma 2(i), #(X) 
has content. For all such sets Y we define (as we may by theorem 
8.44) the non-negative set function 7 by 

o(X)=] fF 
ox) 
@ is also additive, for if X,, ¥, < G and c(X, X2) = 0, then, by 
the lemma of §8.4, c(4(Xq) 0 $(X9)) = c(¢(X1N Xq)) = 0. 
Let p(E, G’) = 36 and put 


H=UBQ@;5, K= UB(Q;9). 
reE reH 


Take x € H and let J, be a closed, cubical interval containing x and 
with p(I,) < 6 so that I, < K°. Since ¢(/,) is connected and compact 
(theorems 3.34 and 3.64), there is a point y € ¢(/,) such that 


o(L,) = fy) e(Pz))- 
By lemma 2(ii) (a) and the uniform continuity of f on the compact 
set £(K), f(y) >f(G(x)) as p(I,) +0, uniformly for xe H. Now J¢é 
is also uniformly continuous on ¢(K) and therefore lemma 2(ii) (5) 


shows that c(P(Iz)) 


aevAVies |J(x)| 


as p(I,) > 0, uniformly for x € H. It follows that 


2 = £0) ED + OCDE), 


uniformly for x € H. Since E has content and E < 1°, theorem 8.53 
gives 
o(e) = [ (fo Hlusl- 


(ii) When Q is not empty (but has zero content), then, for each 
integer k > 1, there is a set S;, the union of a finite number of closed 
intervals, such that S;, > Q and c(S;,) < 1/k. Replace each interval 
of S;, by a similar, concentric, but open interval of twice the content. 
If 7;, is the union of these intervals, then c(T;,) < 2/k. 

Now E-T;, has content (8(d), 5), E—T;, is a subset of the open 
set G—S,, and 


$(E-T,) = $(E-(ENT,)) = 9(E)-$EnT;). 
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It follows from (i) that the integrals 


i f and (fo 4) | 
G(E)—g(En Tx) E-(EnT;) 


exist and are equal. Also f is bounded on ¢(£)(< ¢(£)) and J¢ is 
bounded on E(¢ E). Moreover c(E 1 T;,) > 0 as k > 00 and, since 
|| D¢(x)|| is bounded for x € H, an argument similar to that used in 
the lemma of §8.4 shows that c(¢(En T;,)) > 0. The theorem now 
follows from exercise 8(d), 6. | 


The change of variable technique for evaluating integrals in R’ 
is familiar and the use of theorem 8.61 in higher dimensions is 


analogous. We start with an integral [ f and wish to find a function 


¢ such that, when ¢(£) = D, Hs (fo ¢)|J¢| is more amenable to 


computation than the original integral. Unfortunately as it stands 
the theorem is not quite strong enough to cope with certain situations 
that occur quite frequently. Consider the polar transformation ¢ in 
R? given by 

x = 47,9) =rcos6, y = ¢,(r, 0) =rsind (8.68) 


whose Jacobian J¢(r, 9) is r. When D is a (bounded) closed set not 
meeting the half line {(x, y)|x < 0, y = 0} (or some other half line 
starting at the origin), there is no difficulty. But, even when D is as 
simple a set as the closed unit disc (given by x*+y? < 1), theorem 
8.61 is inapplicable; for a corresponding set E, such as 


0, 1] x [0, 277], 
cannot be enclosed in an open set G in which ¢ is injective. In this 


case a slightly stronger (but more cumbersome) version of theorem 
8.61 is required. 


Theorem 8.62. Let G* be an open set in R” and let E, G be sets with 
content such that G is open and E < G < G*. Suppose also that the 
function ¢:G* > R” is continuously differentiable on G*, injective on 
G and with Jacobian J$(x) + 0 nearly everywhere in G. If the function 
St: ¢(E) = R! is continuous, then the integrals 


fot and foie 


exist and are equal. 
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Proof. We use the same notation as in the proof of theorem 8.61. 
The case E < G and Q = @ corresponds to part (i) of the earlier 
proof. In part (ii) we now let S;, cover the set Q U fr G and have 


E-T, = EnT;, © EnT;, < GnT; = GNT; © GS; = G-Sy. 


The argument then proceeds as before, except that we use the 
boundedness of D¢ on G instead of on H. | 


Example. 


ie e“dx = hJ/n. 


For u > 0, let ue 
E(u) -{ e dx. 
0 


Then E(u) = f eds | ew dy = J et" dx dy, 
0 0 Ss 


where S is the square [0, u] x [0, u] in R®. Let C,, C, be the sectors 
{(x, y)|x > 0,y > 0, x2+y? < u}, 
{(x, »)|x > 0, y > 0, x*+y? < 2u%}, 


respectively, so that C; <¢ S < C,. Since ew > 0, 
I et dxdy <f ev dxdy <{ ee" dx dy. 
A s 0, 


We now evaluate the integrals over C, and C, by using the polar 
transformation ¢ in R? given by (8.68) and appealing to theorem 
8.62. The function ¢ is continuously differentiable in G* = R® and 
injective in G = (0, 2u)x (0, 27); also J¢(r, 0) = r + 0 in G. For 
a set E such that ¢(E) = C, we can take the interval [0, uJ x [0, 47], 
since theorem 8.62 does not require ¢ to be injective on E. We now 
have 


bn ue 
ij e- 1" dxdy -{ erdrd0 -{ ao re dr = 4n(l—e”). 
Cc, EB 0 0 
Similarly i} e-t-"dxdy = }n(1—e7*""). 
Cy 
Hence }n(1—e-’) < EXu) < fn(1-e*") 
and so Eu) > }7 asu> ©. 


The theorems of this section, when interpreted for integrals over 
one-dimensional intervals, are rather weaker than the corresponding 


286 INTEGRALS IN R" [8.6 
results of chapter 6; at first sight they also look different, for they 


lead to the formula 
ij f=f (fo )|9’|. (8.69) 
oD) ve 


However, let J = [a, £] and put 4(a) = a, 4(f) = b. The condition 
that ¢ is continuously differentiable and injective entails that ¢’ has 
constant sign. Hence, when ¢’ > 0, (J) = [a, b] and (8.69) is just 
the relation (6.95) of p. 188; and, when ¢’ < 0, ¢(J) = [b, a] and 


(8.69) is re 
[ir- [ive ox-9, 
b a 


which again reduces to (6.95). The reason why |J¢| appears in 
theorems 8.61 and 8.62, but ¢’ (not |¢’|) in theorem 6.92 is that 


7) b a 
if J is ‘oriented’ (ie. [ f= -{ f) , whereas a multiple integral has 
a a b 


no orientation. 
An affine transformation is a function ¢: R" > R" which is of the 


—_ $(X) = c+A(), 


where c € R" and the function A: R" > R” is linear. Theorem 8.61 
(with f = 1) shows that content is invariant under an affine trans- 
formation with determinant 1 or —1 (a rigid body motion). This 
means, for instance, that the content of any rectangular parallele- 
piped is equal to the product of the lengths of its sides. 

Finally we note that, taking again f = 1 in theorems 8.61 and 
8.62, we obtain two propositions on content which include various 
auxiliary results that had been needed (the lemma of §8.4 and 
lemmas 1 and 2(i) of this section). 


Exercises 8(f) 
1. Let 0 < a < b. Show that, if the bounded set E in R" is such that 
ueéE and frE I(u; b)—I(u; a), 
then I(u;a) © E © I(u; b). 
2. Prove that, in theorems 8.61 and 8.62, the function fneed only be assumed to 
be bounded on ¢(£) and continuous nearly everywhere in $(E). 


3. Show that, in R’, the content of any triangle is equal to half the length of any 
one side multiplied by the corresponding altitude. 


4. Show that, if D is the half-disc {(x, y)|y > 0, x2+y? < 1}, 
ip (x+y)? 2-2 
ID 


dxdy = 


(1+x*+y*) Bays 
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5. The function f: R? + R? is given by f(x, y) = x*/p*+y?/q?. Find the content 
of the ordinate set (see exercise 8(d), 10) of f on the elliptical set 


{(x, y) |x*/a*+y*/b* < 1}. 


6. Use the transformation (x, y) = A(u,v) given by x =u, y=v—u to 
evaluate 


f arc tan (x+y)dxdy, 
D 
where D is the triangle {(x, y)|x > 0,y > 0, x+y < 1}. 
7. Show that the equations u = x*/y, v = y*/x define a continuously different- 
iable, bijective transformation (x, y) = ¢(u, v) on (0, ©) x (0, %) to (0, 0%) x 
(0, 0). Hence find the content of the set 
{(x, ) |x > 0,» > 0, ay < x* < bty, p*x < y® < g’x} 
in R?, where 0 <a<b,0<p<gq. 


8. Use the transformation in R® given by x = rcos*@, y= r sin®0 to prove that 
the content of the set 


is 47/35. 


{% », 2|xttyttzt < 


9. The curve in R? represented by 
x = a(1+2cos t+cos2t), y = a(2sint+sin2r) (0 < ft < 2m) 


is called a cardioid (p = q = 1, and change of origin, in exercise 8(a), 7). Show 
that the trace of this cardioid is given by the equation 


r = 2a(1+cos 4) (0 < @ < 27) 


in polar co-ordinates. 
Find the content and centroid of the set 


S = ((rcos 6, r sin #)|0 < r < 2a(1+cos 9), 0 <0 < 27} 


in R®, (The centroid (&, 7) of a set E with content c(E) > 0 is defined by the 
equations 


Ec(E) = [ xaea, ne(E) = [rae 


10. The set of points (x, y, z) in R* such that 8az > x*+y*(a > 0) is denoted 
by S; and P is the plane with equation x+y+2z = 8a. Find the content of the 
(bounded) set Q cut off from S by P. 


11. A cylindrical hole of diameter a is drilled through a solid sphere of radius a. 
Find the content of the material removed if (i) the hole is symmetrically placed, 
(ii) the centre of the sphere lies on the edge of the hole. 

(In (ii) the set whose content is to be found may be taken to be 


{(x, y, z) |x? +? +2" < at; x*+y" < ay}. 


Note that the polar equation of the circle x*+y* = ay in R® is r = asind 
(0 <0<7)) 
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12. (i) Prove that, for n> 2, the n-dimensional polar transformation 
(ay «-y Xn) = P(r, 1, «+3 Ona) given by 

x, = rcos ™, sin 4... sin Oy» sin An_4, 

X_ = rsin 0, sin 4 ... sin O,_. sin Any, 
sin On, 


Xs = rcos 4, sin A . 
Xn-1 = cos 6,_, sin 6,3, . 
X, = rcos 6,_, 
has Jacobian 
IPP, 4, 2065 na) = (—1)"r" sin A, sin? 9, ... sin"*4,,_, 
and is injective on every open interval 
(0, a) x (0, 277) x (0, 7) x... x (0, 7). 


(ii) Show that, in R", the content c,(a) of an open or closed ball of radius a is 
man when n=2m (m= 1,2,...), 
m: 


2m+1yp | 
re when n= 2m+1 (m=0,1,...). 


Note that, for every a, c,(a) > 0 as n > 00, 
(Fork =10) 15-2555; 


(2k)!7 
224(k 1)?” 


oe 22k 1}! 
2h+1 eee ed SETS 
iF sin’ do Qk+D!? 


" 
f sin**6d0 = 
0 
see, for instance, C1, 133.) 


13. Let S be the portion of the closed unit ball in R* which lies in the positive 
octant (where x, y,z > 0). Evaluate 


yz 
ea eye 


14, Green’s theorem for a disc (cf. theorem 8.31, corollary 3). Let G be an open 
subset of R® which contains the closed unit disc B; and denote the positively 
described unit circle by 0B. Prove that, if the function f = (f,, fz): G > R® is 
continuously differentiable, then 


Lf = J Pus Df). 


* é F é ; : 
Di flr cos t, rsin t)r = pp Late cos f, r sin f)r cos 1) 5, Later cos 7, sin r) sin f] 


(Show that 


and derive a similar formula for D,f,(r cos ¢, r sin t)r.) 
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8.7. Functions defined by integrals 

Let I,J be closed intervals in R” and R” respectively. If the 
function f:/xJ—> Ris such that, for each y €J, f(., y) is integrable 
over J, we consider the function ¢ on J given by 


#0) = [fo ae. 


The question we pose is what conditions on f will ensure the pro- 
perties of integrability, continuity and differentiability for ¢. Actually 
we have already dealt with the first of these properties. Theorem 8.48 
shows that, if fis integrable over J x J, then ¢ is integrable over J and 


[9 =a 


(In this context ¢ need only be defined nearly everywhere on I) 


Theorem 8.71. If the function f:1xJ—> R* is continuous, then, for 
every yeéJ, f(.,y) is integrable over I and the function ¢:J > R* 


defined by 
60) = f fls sax 


is continuous on J. 

Proof. The integrability of f(., y) for each y is obvious. Next, 
since [x J is compact, f is uniformly continuous. Thus, given e > 0, 
there is a 6 > O such that 

fe Y-SOY)| < € 
whenever 
(9), y)ETxJ and |x-x'|?+[y-y/l? < 
(where ||x— x’|| and ||y—y’|| denote norms in R” and R” respectively). 
Therefore, if y, y’ €J and ||y—y'|| < 4, 


190)- 20) < [les VS yi dx < ec). | 


In the next theorem, on the differentiation of ¢, we take J to be 
an interval [c,d] in R'. This is the most important case; for the 
general case see exercise 8(g), 3. 

Theorem 8.72. (Differentiation under the integral sign.) Given the 
function f:1 x [c,d] > R' (I < R™), suppose that 


16) = [fe y)dx (8.71) 
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exists for some y in [c, d] and that D,,,,f exists and is continuous on 
Ix[e, d]. Then $(y) exists for all y in [c, d], the function ¢ is differenti- 


able and 
#0) = ji DnisS(x, y)dx (¢ < y < d). (8.72) 
In the classical notation (8.72) takes the expressive form 
d t) 
Gp) for ndae = [Ff de. 


Proof. Suppose that 
[fos nax 


exists, and take any y in [c, d]. Then, by theorem 6.84, 


fe, 9) fe, 0) = if ; Dyas fl, thdt 


for each x €J; and, by theorem 8.71, the right-hand side defines a 
continuous function on J. Since f(., 7) is integrable over J, so there- 
fore is f(., y); in other words, (8.71) exists for all y in [c, d]. 

By theorem 8.71, the function y on [c, d] given by 


HO) =f Dnarfs yx 


is continuous. Then, by theorem 8.48 (or theorem 8.31, corollary 1) 
and, again by theorem 6.84, we have, for c < y < d, 


[vou = [ae DussSts Ndx = [, axl” Dyas flor, Oat 


= [fe ») fos olde = $0)-600. 
Finally, since y is continuous and therefore 
d fv 
pl vod = HO), 
it follows that $’(y) exists and is equal to y(y). | 


The results we have so far obtained in this section have analogues 
for functions defined by improper integrals (in R). We shall state 
all theorems for functions ¢ given in the form 


00) = [Aes ax; 
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other improper integrals are treated in the same way. The notion of 
uniform convergence once again occupies a key position. 


Theorem 8.73. If 
(i) the function f:[a, 0) x J > R' (J = R") is continuous, and 


(ii) h F(x, y)dx converges uniformly for y €J, 
then the function ¢:J -> R' given by 
60) = [fls »)dx 
is continuous on J. 
Proof. By (i) and theorem 8.71, each function $,(” = 1, Drees) 


defined by atn 
#0) = f°" feaydde Qed) 


is continuous on J; and by (ii) the sequence of functions ¢, con- 
verges uniformly to ¢. Hence ¢ is continuous on J. | 


Theorem 8.74. Suppose that the function f:[a, 0) x[c, d| > R' satis- 
fies the following conditions: 
(i) for every X > a, f is integrable over [a, X] x [e, d]; 


a 
(ii) for every X > af F(x, y) dy exists nearly everywhere in [a, X]; 
e 


(iii) {. f(x, y)dx exists and converges uniformly for c < y < d. 
a 


a i dy fc St(x, y)dx and fe dx f: (x, y)dy 


exist and are equal. 


Proof. By theorem 8.48, for every X > a, 
‘a x x a 
[ra f'fonde and [Pax] se 0 
ec a a ec 
exist and are equal. 
ath 
Next, since the functions ¢, given by ¢,(y) = F(x, y)dx are 


integrable over [c, d] and $,(y) > ¢(”) = { F(x, y)dx uniformly for 


c < y <d, it follows from theorem 5.22 that ¢ is integrable over 
[c, d]. To prove the theorem we show that 


ras’ fo. na > far" fas 
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as X - co. Now, given € > 0, there is an X, such that 


sup [fj 20a <eé 
e<y<d |JX 
for all ¥ > Xy. Then, for ¥ > Xo, 
d co) x da 
[afford fax [70,045] 


i I dy [10x yas [ay [fox de 


< fay [ 70 na < (d-e. | 


Note that conditions (i) and (ii) are both satisfied when f is con- 
tinuous on [a, «) x [e, d]. 


Theorem 8.75. (Differentiation under the integral sign.) Given the 
function f:[a, ©) x [c, d] > R', suppose that 


@ #0) = [fos ode 


exists for some y in [c, d]; 
(ii) D,f exists and is continuous on [a, ©) x [c, d]; 


(iii) e D, f(x, y)dx converges uniformly for c < y < d. 
Then f F(x, y)dx exists and converges uniformly forc < y < d, the 
faction ¢ is differentiable and 
#0) =|" Dif dx (<< Ad). 
As in theorem 8.72, the last identity may be written 


Sp), fos nddx = [Eft »)de. 


Proof. Suppose that i J(x, 9) dx exists. By (ii) and the first part 


xX 
of theorem 8.72, [ J (x, y) dx exists for all X¥ > a and all y in [e, d]. 
a 


In view of (i) and (iii), given ¢ > 0, there is an X, such that, 
whenever XY, > X, > Xo, 


ba Xs 
IR Dz f(x, Dar <e for c<t<d, and ces n)dx| <, 
xX, Xi 
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Now take any y in [c, d]. Then, by theorem 6.84 and theorem 8.48 
(or theorem 8.31, corollary 1), we have when X, > X; > Xo, 


Je 70 9-Fes mae| = |f" ae” Dest, na 


= [fap Dif (x, Dar 
< |y—ale < (d—c)e, 


and so 
[fe ses »ode| < 


Therefore, by the general principle of uniform convergence (6.34), 


[i fe. nar] +(d-e < (l+d-c)e. 


. F(x, y)dx exists and converges uniformly for c < y < d. 
a 
By theorem 8.73, the function y on [c, d] given by 
Hy) = [Daf da 


is continuous. Theorems 8.74 and 6.84 now show that, fore < y < d, 


['voa - ii ar| Dafle, Ne = iF dx" Daflx, t)dt 


= [9-0 ode = $0)-$00. 
But, since 7 is continuous, 
5 [ woat = vo) 
dy Je ; 
Therefore ¢’(y) exists and is equal to y(y). | 


The last three theorems invite comparison with theorems 5.21-5.23 
which describe the limit functions of uniformly convergent sequences. 


Example. For y > 0, 
Pee Rin ele 
f e7t Se dx = 37 are tan y. (8.73) 
(i) y > 0. Comparing the integrand with e~*” we see immediately 


that the integral exists. 
We have a 


<p SX oe F 
5le oy —- ) = —e sin x. (8.74) 
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Also the function defined by (8.74) is continuous on R? and, by the 

M-test (6.35), 20 

J (—e-* sin x) dx 
0 


converges uniformly on any interval [c,d] with c > 0. Hence, by 
theorem 8.75, if ¢(y) is the integral in (8.73), 


oy --[° e-Y sin xdx = “Ta 


for c < y < d. Thus there is a constant A such that 
#(y) = A—arc tan y (8.75) 


when y€[c, d]. But [c, d] is an arbitrary interval such that c > 0 
and so (8.75) must, in fact, hold for all y > 0. 

To determine A we note that 
1 


\o0)] < [Pema = 5. 


Therefore, letting y > oo in (8.75), we obtain 0 = A—4n, ie. (8.73) 
holds for y > 0. 

(ii) The fact that (8.73) holds for y > 0 follows at once from the 
example at the end of §6.9 where it was shown that 

sin x 7 
f; a -5. (8.76) 

But we can also use the methods of the present chapter to evaluate 
this integral. 

We first prove that the integral in (8.73) converges uniformly for 
y > 0. For x > 0, e~*”/x is positive and decreasing in x. Hence, by 
the second mean value theorem (6.93), 


eon wg 2 as| < — =f. sin xdy| < ¥ 
xX, mG 


xX, 
when X, > X¥, > 0 and y > 0. Since 2/¥,->0 as X,->0, the 
general principle of uniform convergence shows that the integral 
defining #(y) converges uniformly for y > 0. 
We now know from theorem 8.73 that ¢ is continuous on [0, co). 
Therefore, by (i), 


9(0) = lim ¢(y) = lim (47—are tan y) = 47, 
yor0+ y0+ 
i.e. (8.76) holds, 
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Exercises 8(g) 
1. Suppose that the function /: [a, 0)xJ> RV R°) is continuous and non- 
negative, that a 
60) = [fl vas 
la 
co 
exists for all y¢J and that ¢ is continuous on J. Prove that i F(x, y)dx con- 
a 
verges uniformly for y € J. (Cf. Dini’s theorem 5.35.) 


2. Let I be the closed interval [a, b] x [c, d] in R® and let the function f: J > R* 
be continuous. For (x,y)¢J°, put J(x,y) = [a,x] x[e, y]. Prove that the 
function F: [° > R' defined by 


F(x, y) = ie 
J(ayy) 
is such that, for all (x, ») € 7°, 
D,D, F(x, y) = DzD, F(x, y) = f(x ¥). 
(Cf. exercise 8(d), 8.) 


3. Let J, J be closed intervals in R” and R” respectively. Suppose that the 
function f: 1x J > R* is such that 


60) = [ Fes nex 


exists for some y €J, and the partial derivatives Dingif, -.., Dminf exist and are 
continuous on [x J. Prove that 4(y) exists for all y € J, that 


Dg) = [ Pasi )dr Sk < myED, 


and that ¢ is continuously differentiable on J°. 
4. Show, by an example, that in theorem 8.72 the condition that 


[en nox 


exists for some y in [c, d] may not be omitted. 


5, The function ¢ on R? is defined by 
tn 
G(x) = [ cos (x sin ¢)dt. 


Show that y = (x) is a solution of Bessel’s differential equation of order 0: 


FY Dy 
eat ate = . 


6. The function ¢ on R'—{-1, 1} is defined by 
7 
Pa) = f log (1—2a cos x+a*)dx. 


Prove that 4’(a) = 0 and hence evaluate (a) for |a| < 1 and for |a| > 1. 
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7. The function f: [a, 5] x [c, d] > R! is continuous and such that D,f exists and 
is continuous. Also the function g: [c, d]> [a, b]is differentiable. Show that the 
function ¢ : [c, d]-> R' defined by 


‘ay) 
oY) -{ L(x, y)dx 
is differentiable and that 
au) 
#0) = [P" Difle ndrte' ODEO): 


The function F on (— 47, 47) is given by 
vy 
F(y) = ih log (1+tan x tan y)dx. 


Prove that F’(y) = log sec y+ytan y and deduce that F(y) = y log sec y for 
-in<y <4. 


8. Let B be an open ball in R” and let the function f = (f,, ...,f.): B> R" be 
continuously differentiable. Prove that a necessary and sufficient condition for 


i! f to be independent of path jn B is that, in B, Dif; = D;f; (i,j = 1, ...,n). 
im 
(See exercises 8(6), 7 and 8.) 


9. Prove that, if 0 < a < b, then 


b co ey » 
i dy I e-“dx and f dx il e-“dy 
a 0 0 a 


exist and are equal. Hence evaluate 


0 pdt _ ede 
ip * de 
0 x 


(This integral may also be evaluated by the Frullani method of exercise 6(i), 2.) 


10. Prove that 


1 P 20 1 5 F co A 1 1 
[ w | 1+x?+y? se ip «| igeay” 
exist and are equal. Deduce that 


4” arctan (sin 9)», _ 
ih ae — dO = 47 log (1+ 2). 


11. Let ¢ on R' be defined by 
_ [% (sin xy\* 
00) = [° (2) 


Show that 4’(y) = 47 for y > 0, and hence evaluate 4(y) for all y. 
Use a similar method (and the formula 4 sin? 6 = 3 sin 0—sin 30) to evaluate 


CJ i 3 
f (= 2) ae 
0 x 
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12. Show that a 
$y) = j e-* cosh xy dx 
0 
exists for all y and everywhere satisfies the differential equation ¢’(y)—4y¢(y) = 0. 
Hence evaluate ¢(y) for all y. 


13. The function ¢ on R? is defined by 


_ [*_sinxy 
0) -f xd+x) 


Prove that, when y > 0, 6"(y)—¢(y) = —4. Hence find ¢(y) for all y. 
14, The function ¢ on R? is defined by 


Fey fi © arc tan oa ate tan bx i 
Prove that, fora > 0, b > 0, 
id ce Sears 
DiDiGE ES 3 G+ atx) (1+ 5x4) ~ a+b 
and d(a, b) = 4n{(at b) log (a+ b)—a log a—b log 5}. 


15. Suppose that the function /: [a, 0) x [b, 00) > R* is non-negative and, for 
every Y > 5, ie ¥ va iS 

f de | S(x,y) dy, jf ay [ L(x, pdx 

a o b a 


exist and are equal. Show that, if one of the expressions 


ie dx f f(x, »)dy, fs dy [fs (x, y)dx 


exists, then so does the other and the two are equal. (Cf. theorems 4.73, 6.33.) 


Evaluate a ae 
ii dx [ eer” 


NOTES ON CHAPTER 8 


§8.1. In chapters 10-14 we generally deal with paths, i.e. equivalence classes 
composed of piecewise continuously differentiable transits. The definition of 
equivalence which we use is best suited to such transits. In a context where 
differentiability properties are unimportant, we might call the transits ¢ : [a, 6] > 
R", i: [c, d]> R" equivalent if, simply, there exists a strictly increasing, con- 
tinuous function « such that a(a) = c, a(b) = dand ¢ = you, 

In the definition on p. 248 the supposition that ¢: [a,b] R" (n > 1) is 
continuous could be omitted. The expression 


sup 3 |6t)— 44, («) 
@ i=l 


if finite, is then more appropriately called the variation of ¢ and denoted by 
v2(d). However this extension of the concept of bounded variation does not lead 
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to an essentially new class of functions, for the proof of theorem 8.11 (in which 
continuity is not used) shows that (*) is finite if and only if the components of 
¢ are of bounded variation. 

A space filling curve was first constructed by G. Peano (1890). The example 
in exercise 8(a), 11 is due to I. J. Schoenberg (Bull. American Math. Soc. 44 
(1938), 519) who simplified an earlier construction of Lebesgue’s. 


§8.4. Surfaces, like transits, are naturally grouped into equivalence classes. 
The manner in which this is done again depends to some extent on the circum- 
stances. For instance the two surfaces y: G > R", /*: G* > R" (G, G* < R”, 
1 < m < n) could be taken to be equivalent if there exists a bijective, continuously 
differentiable function a: G— G* such that Ja > 0 throughout G and Y = 
yr*o a, The restriction on the functions to be continuously differentiable is an 
indication of the considerable difficulties with which the theory of surfaces is 
bedevilled. 

The phrase ‘nearly everywhere’ (meaning ‘except in a set of zero content’) 
corresponds to the phrase ‘almost everywhere’, used in the Lebesgue theory of 
measure and integration, which means ‘except in a set of zero measure’. (In the 
notes at the end of chapter 6 we defined one-dimensional zero measure; the 
generalization to R" involves no more than the replacement of length by volume.) 
Since a set of zero content necessarily has zero measure, ‘nearly everywhere’ 
implies ‘almost everywhere’; but the opposite implication is false. 


§8.6. Two results (theorem 8.31, corollary 3 and exercise 8(f), 14) have been 
labelled special cases of Green’s theorem. With the material at our disposal only 
a general description of the parent theorem is possible. Suppose that the trace 
of a path y in R® is the frontier of a bounded set E and that f = (f,,f) isa 
function on E to R*. Green’s theorem states conditions under which 


i t= ff @n-Dito. 


© sin x 
[Ma 
0 x 


§8.7. The integral 


has now been evaluated in two different ways (in this section and in §6.9). A 
further method, depending on complex function theory, will be found in §14.1, 
example 2. G. H. Hardy made an entertaining comparison of a number of methods 
of calculating this integral, assigning marks for simplicity, elegance, etc. 
(Mathematical Gazette 5 (1909), 98-103 and 8 (1916), 301-3.) 


9 
FOURIER SERIES 


9.1. Trigonometric series 
This chapter contains salient facts about trigonometric series of the 
form = 
4ay+ ¥ (a, cos nx +b, sin nx), 
n=1 


which we shall sometimes write more shortly as 
X Ant). 


The topic has intrinsic importance in the expression of the periodic 
phenomena which occur in all branches of natural science. Moreover 
it will give the reader valuable practice in applying principles and 
theorems from earlier chapters, notably 4 and S. 

The history of the subject is of high interest and is outlined in a 
note at the end of the chapter. Repeatedly the settlement of a con- 
troversy or the resolution of a difficulty thrown up by trigonometric 
series has clarified the foundations of analysis or has engendered new 
ideas and methods. 

The central problem of the chapter is the validity of the formula, 
say for x in [—7, 7], 


F(x) = 449+ 3 (a cos nx+b, sin nx). (9.11) 


The coefficients a,,, b, are real and the function fis from R* to R’. 
The sum of the series on the right of (9.11)—if it converges—has 
period 27, so it is convenient to suppose that f is defined for all 
values of x and that f(x+27) = f(x). (If an fis assigned for which 
S(m) + f(—7), then f can be redefined at one or both of these values.) 

We shall always suppose that f is Riemann integrable (§6.7) over 
[-7, 7. 

Let us make the assumption that the series on the right of (9.11) 
converges uniformly in [—7, 7]. The convergence remains uniform 
when we multiply by either of the bounded functions cos x or 
sin nx. We can then integrate term by term over [—7, 7] by theorem 
5.22. 


300 FOURIER SERIES [9.1 
Use the facts (the orthogonality of the cosine and sine functions) 


f sin mx cosnx dx = 0 (all m,n), 


7 ‘7 
f cos mx cos nx dx = i sin mx sinnx dx =0 (m+n), 
=n 


[7 ose nx dx = [sine nxdx=T7 (n+ 0) 
and, ifn = 0, [cos nx dx = 2m, 
The result of integration term by term is - 
a, = 7 fe) cosnxdx, b, = {fe sin nx dx, (9.12) 


(Note the reason for the factor 4 in the term 4a, in 9.11.) 

We repeat that the passage from (9.11) to (9.12) is purely formal 
in default of some justification such as the uniform convergence of 
the series in (9.11). We can, however, starting with an integrable f, 
define the numbers a,,, b,, from it. 


Definition. The numbers a, b, given by (9.12) are called the Fourier 
coefficients of f. The series (9.11) with these values of a, b, is called 
the Fourier series of f. 

From the periodicity of the integrands in (9.12), the interval 
[0, 9+ 27] for any 4 would serve to determine a,, b,. 


Theorem 9.11. If we are given a trigonometric series 
= . 
tog+ D(a, cos nx+f,, sin nx) 
1 


and it converges uniformly in [0, 0+ 27], then it is the Fourier series of 
its sum. 


Proof. Let s(x) be the sum. We can integrate the uniformly con- 
vergent series term by term after multiplying by cos mx or sin mx. 
This proves that 


1 O+2n iD O+2n F 
Oy, = = f s(x) cosnxdx, B, = ls s(x) sin nx dx. | 
T Jo ) 


From the definition, the Fourier series of a given function is 
unique. The converse does not hold without restriction on the 
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function. If g(x) = f(x) except for a finite number of values of x 
(more generally, except in a set of content zero), the corresponding 
integrals (9.12) are equal and f, g have the same Fourier series. The 
next theorem shows that two different continuous functions cannot 
have the same Fourier series. The reader should note this fact but 
he may appreciate the proof better if he defers it until he has gained 
more familiarity with trigonometric series (e.g. from §9.2). 


Theorem 9.12. If the R-integrable functions g, and gy are continuous 
at c and g,(c) + g,(c), then the Fourier series of g, and g, are different. 


Proof. Suppose the conclusion false. Then all the Fourier coeffici- 
ents of f = g,—g, vanish, and f(c) + 0, say f(c) > 0. 
If ft, is any trigonometric polynomial 


™ 
Ja+ ¥ (a, cos nx+ f,, sin nx) 
1 


and 7 is any number, then 
+20 
f fi = 0: (9.13) 
9 


Since f is continuous at c, we can find h (with 0 < h < 7), k such 
that f(x) > k > 0 for c—h <x <cth. 

We now take t,, to be defined by 

t,(x) = {1+cos (x—c)—cos h}™. 
Then t,,(x) may be shown to be a trigonometric polynomial. It has 
the properties 
() tr(x) > 1 for c-h<x<cth, 
(ii) as m > ©, t,,(x) > 00 uniformly for 
c-th<ex< c+th, 

(iii) |ta(X)| <1 for e+h <x <c—h+2n, 

Then, by (i) and (ii), 


c+h e+th 
f | “fm > hk inf tp(x)> 0 as moo, 
ae pate o—h+ 2a 
Also, by (ii), \ 
eth 
is bounded. So, if m is large enough, 


c—h+ er 
{ts 
c—h 


cannot be 0, which contradicts (9.13). | 
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Corollary. If f is continuous and the Fourier series of f converges 
uniformly, its sum is f. 


Proof. If the sum is g, then from theorem 9.11 the series is the 
Fourier series of g. Now apply theorem 9.12. | 


Note on complex Fourier series, Some results are more elegant if 
expressed not in cosines and sines but in the equivalent complex 
exponentials. We have 

yes y 0 3 
c ine dy = 
an is dx CC Take = gre AVE 
=1 @=0). 
The formal Fourier series of f, in general complex and equal to 
gtih, say, is then 


ll 


cy 


2” 
D Cp et? = Cy+ x (Cy e** + c_, e-2), 
-—0 


1 : ing 
where Cn = 57 fy f@)ies™ ax. 
b 
(The integral of a complex function [ {p(x) + ig(x)} dx is defined 
a 


to be i P(x)dx+ if a0 dx.) 


It is easy to verify that a necessary and sufficient condition for f 
to be real is that, if c, is «,+if,, then c_, is its conjugate a, —if,,. 

It will be convenient to confine ourselves in this chapter to real 
functions and to cosines and sines. 


9.2. Some special series 


Before studying general theorems about Fourier series, it is 
desirable to make oneself familiar with particular examples. 


Example 1. Prove that the Fourier series of the function which is equal 
to x* in[—7, 7] is 


2 
Us 4{ 2% 4 SS aS rye 208 nx 


State the sum of the series for all values of x. 
Deduce that 
L.<4 1 ire 
6° 


ptpte-trat- 
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Solution. By definition of Fourier series, the constant term and 
the coefficients of cos nx (n > 1), sinnx are 


st ‘a x®dx, z f x* cos nx dx, =f" x* sin nx dx. 
TS ace Rae oe 
Since x? is an even function, the integral with sin nx is 0 for all n, 
and the cosine integral is most easily evaluated as twice the integral 
over [0, 7]. Integration by parts gives the series required. 

The series converges uniformly for all values of x by Weierstrass’s 
M-test (theorem 5.32). By theorem 9.12 (corollary), the sum for 
—m < x < mis x*. The sum outside this range is (x — 27)? in [7, 37], 
(x—4n)? in [37, 57] and so on (the parabolic arcs being seen more 
vividly in a diagram). 


Putting x = 7, we obtain the sum y (1/n?). | 
1 


Example 2. Prove that the Fourier series of the function which is equal 
to x* in (0, 27) is 


=a t+ z (3.05 nx sin nx) 
Si eae n : 


Calculate the sum of this series for x = 0. 
Solution. To obtain the series, we have only to work out the 
constant term and the coefficients of cos nx, sin nx. 


1 2" 1 2" 1f27 . 
=), x*dx, | x* cos nx dx, — i x* sin nx dx. 
2m Jo Jo 7 Jo 


Outside the interval (0, 27) the function which has this Fourier 
series has, by periodicity, the value (x —2k7)? when 


2kn < x < Ak+1)7 


for every positive or negative integer k. The function may be given 
an arbitrary value for x = 2k; whatever value is assigned, the 
function is discontinuous there. 

The only convergence theorems so far proved (9.11 and 9.12) say 
nothing about the possible sum of the Fourier series of a discon- 
tinuous function. Such theorems will follow in §9.4. 

This example shows a phenomenon which will be found later to 
be general. At a discontinuity x = c of f at which the right- and left- 
hand limits f(c+) and f(c—) exist, the Fourier series of f will, if it 
converges, have the sum 4{f(c+)+/(c—)}. 
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Taking here c = 0, we have as the sum of the series 


ant 2 4 
ot aw 


which is 27? from example 1. As x > 0+, the function x* in (0, 27) 
tends to 0. As x > 0-, the function (x+ 27) in (—2z, 0) tends to 
4n°, 

Fourier cosine series and sine series. We saw in example 1 that, 
if f is even, i.e. f(—x) = f(x), its Fourier series contains cosines only. 
Similarly if f is odd, i.e. f(—x) = —/(x), the integrals for a, are all 
0 and we have sines only. 

If, then, f is defined in the interval [0, 7], there is a Fourier cosine 
series associated with the even function in [—7, 7] coinciding with f 
in [0, 7]. Similarly, if fis defined in (0, 7) and we define 

SO =f@) = 9, 
there is a Fourier sine series associated with the corresponding odd 
function in [—7, 7]. 
Example 3. Let f(x) be defined in [0,7] to be x in [0,47) and m—x 
in [4n, 7]. Prove that the Fourier cosine series of f is 
m 2(cos 2x , cos 6x , cos 10x 
4 = ( pP oF 3 te 5 +..). 
Prove that the Fourier sine series of f is 
4 (5 x_ sin 3x, sin 5x_ ) 
= aalhe 


Po te 

The only feature not present in Example 1 is the necessity to divide 
the range of integration into [0, 47], [47, 7] in calculating the Fourier 
coefficients. 

As in Example 1, the series are uniformly convergent to the 


appropriate f(x). 
Example 4. Prove that the series 
© sin nx 
n=l 


converges to 4(m—x) for 0 < x < 2m, 

Notes. (1) We have previously shown in the example on p. 118 
that this series converges for all values of x, and that the convergence 
is uniform for é<x<2n-8 
for any fixed positive 6. 
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(2) Observe that we have not here mentioned the phrase Fourier 


series. We shall solve the example from first principles. 
Solution. Write 


y sin rx 
Sy(X) == aa 
Then S,(x) = z z cos rx = —4+ s Gane 
So S,(x) = —4¥ + [ee at 


Putting x = 7 in this, we have 
nen +f" sin (ntHt 
a ~2sin 4t 
By subtraction we have 
eons _ {7sin (n+3)t 1, 
ana) -s,(2) = [SP a 


The right-hand side, integrated by parts, is 


[ cos (n+4)t I [eget Deco Hay 
2n+4)sin itl], J2 4(m+4) sin? 


If dé < x < 21-6, the modulus of this does not exceed (say) 


1 7 
(n+l) sin 38* 2@Qn+ 1) sin® 40" 
We have thus proved that the series 


2 sin nx 
n=1 n 


converges to 3(—x) for 0 < x < 27. Moreover the bound obtained 
for |s,(x)—4(7—x)| shows that the convergence is uniform for 
3 <x < 21-6. (This result had previously been deduced from 
theorem 5.33.) The sum of the series (obtained by periodicity out- 
side (0, 27)) is discontinuous at 0, + 27.... 

It is easy to verify that the series is the Fourier series of its sum, 
as defined by (9.12). 

We add one further property of the series which will be used later 
(in theorem 9.51), namely the existence of a constant B such that 


|s,(x)| < B for all x,n. 


In proving this we may assume 0 < x < 7, 
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Let m = min (n, [7/x]), where [a] means the integral part of a. 


Then 
so) = (E43 


m+1 


sin rx 
5, ) = t +t, say, 


where the sum /, is empty, and so zero, if m = n. Then, using the 
inequality sin u < u valid for u > 0, we have 


|| < x31 = mx <7, 
1 
Also, from example (p. 91) and the inequality sinu>2u/7 (0<u<4n) 


lal < oa Gee <b 
al“ (m+1) sin 3x ~ (n+1)x~ * 


Exercises 9(a) 


1. Calculate the Fourier series of |x| for —7 < x < 7. What function does the 
series represent for other ranges of x? 
Sum the series ba 1 


2 (2n+ 1)" 


2. Prove that, if a + 0, the Fourier series of e in (—7, 7) is 


ashanti sae 1)" (a cos nx—n sin nx) 
7 at net nW+a* 


3. Prove that, if -7 < x < 7 and ais not an integer, 


2a sin av 
cos ax = 


marl cos x | cos 2x __ 
2a a1" a4 i 


Hence express cot a7 as an infinite series of partial fractions. (This result will 
be examined more generally, for complex a, in $14.3.) 


4. Prove that, for a range of x to be Se 


cos ae 
=f 41 


|sin x| = =-- oo 
5. Expand cos bx in a sine series for 0 < x < 7, taking 4 to be (i) not an integer, 
(ii) an integer. 
6. Prove that the function f defined by 
{O = 40-2) for -«<0<a(<n), 
£0) =4a@7—0) for a<6< 27-a, 
is represented in [—«, 277—«] by the series 
so sin nO sin no 
n=1 ne 
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What locus in R? is represented by 
& sin nx sin ny 
———— = 0? 
> nw 
7. Prove that the following three expressions all represent x(/— x) for 0 < x < I: 


8/2 2 sin (2n—1)(7x/l) . 2 & sin® (nrx/I) 


Mer (2n-1)8 ” ay my ee! 
abel: = cos (2nmx|1) 
6 ro nm 


8. Prove that the function /*— x? has, in the range [—/, /], the Fourier series 


1 (- he nmx 
42 = 

an (2-2 nm & aaa (Be he 
9. The function fis defined in the range [0, 7] as 


S(x) = ix when 0 <x <1}, 
f(x) = 40 when }7 <x < 47, 
F(x) = ner when 37 <x <7. 
poeratat f®= £5 sin 4(2n—1)7 sin Qn=1)x_ 
T (2n—1)* 
10. We proved in §9.2, example 4, that 
2 sin rx 
x al esiitard. 


t 
Sharpen the bound to ie amt dt+1, The exact supremum is fs — tots this is 
0 


harder to prove (Gronwall, Math. Annalen 72 (1912), 228-61). Pre, for the 
analogous integral, that, for all 7, x, 


9.3. Theorems of Riemann. Dirichlet’s integral 


The first theorem of Riemann (extended later by Lebesgue) 
includes the result that the Fourier coefficients a,,b, of an R- 
integrable function tend to 0 as 7 tends to infinity. 


Theorem 9.31. (Riemann-Lebesgue.) If f is R-integrable over [a, b}, 

then b b 

) JS (x) cos Axdx and F(x) sin Ax dx 
a a 


tend to 0 as A tends to infinity. 


Proof. It is sufficient to give the proof for the cosine integral. 
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Given e¢, take a dissection 


B= Xp SX Ngee Steg Sy =D, 
n 
such that Y (M,—m,)(x,—x,-1) < & 
r=1 


where M,, m, are the supremum and infimum of f in [x,_, Xl. 
Define g by putting g(x) = m, for x, < x < x,. Then 


f. S(x) cos Axdx = f. {f(x)—g(x)} cos Axdx + fee) cos Axdx, 
The first integral on the right is numerically at most 
[ifeo-eealde < E(t, -m)(— Aa) < 6 
The second integral is 
Sm, (sin Ax,—sin Ax,,)/A 


which is numerically less than or equal to 
2 |m,|)/A 
and this is less than € if A > A,(¢). | 
Taking A = n and [a, b] = [—7, 7] we have the result for Fourier 
coefficients. Without restricting f it is not possible to make any 
assertion about the rapidity with which a, b, tend to 0. As a speci- 


men of an improved result under an additional assumption about f, 
we quote the following theorem. 


Theorem 9.32. If f is of bounded variation in[—7, 7), then, as n > 00, 


ee o('). Bhs o(;). 


Proof. From theorem 6.43, we may suppose that f increases in 
[-7, 7]. By the corollary to the second mean value theorem 6.93, 


fi I(x) cos nxdx = na" cos nxdx+-fta) | "cos nxdx 
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Theorem 9.33. (Dirichlet’s integral.) The n-th partial sum 


Sn = Sp(X) = 4a)+ ¥ (a, cos rx+b, sin rx) 
r=1 
of the Fourier series of f at x is 
tf, Palt—9F( at, 


where the Dirichlet kernel D,(u) is defined by 


sin (n+4)u 


D,(u) = 2sin4u 


Proof. Note that D,(u) may be left undefined at u = 0 or may be 
defined as its limit n+4. 
Forr = 0;.1 2) .55 


a, cos rx +b, sin rx 


= (fs (2) cos ridt) cos rx+ Gf", F(t) sin rdt) sin rx 


= +f, cos r(t—x) f(t) dt. 
Substituting in s, we have 
a tf f +3 cos r(t— 10 dt 
which leads to the result. | 


There are easy variants of this formula for s,; it is to be borne in 
mind that f and D,, have period 27 and so any range of integration 
of length 27 will serve. We have then 


s(x) = + f * Dau) floe+u) du 
Putting in this formula —u for u in (—7, 0), we have 


sy(0) = 2 {” Dau flu) +f — wh du 


We note also that 
ii D,(u) du = is (3+ = cos ru) du 
0 0 1 
= in. 
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We can now state as a separate result one of the most useful 
conditions for convergence of a Fourier series. 


Theorem 9.34. A necessary and sufficient condition that s,(x) con- 
verges to s as n > © is that 
fF 2c sco a 
tends to 0 as n tends to 0, where 
Pu) = P(x, u) = f(x+u)+f(x-u) —2s. 
Proof. From the immediately preceding work the integral is 


m(Sn(x)—5). | 


Theorem 9.35. (Riemann’s localization theorem.) The convergence 
or divergence of the Fourier series of f at x depends only on the values 
of f in an arbitrarily small neighbourhood (x — 6, x +8) of x. 


Proof. From the remark following theorem 9.33 we have 
8 mr 
S,(x) = t (, +{’) D,(u){ f(x +u)+f(x—u)} du. 
In [6,7], {f(x+u)+f(x—u)} cosec 4u being the product of two 
integrable functions is integrable. By the Riemann—Lebesgue theorem 
9.31, the term "in the formula for s,(x) tends to 0 as n tends to oo. 


é 
So s,(x) and the integral from 0 to 6 in the formula for it both 
converge to the same limit as 7 tends to infinity or both diverge. 
The integral involves only the values of fin (x— 64, x+6). | 


We close this section with a modification of theorem 9.34 which 
is often easier to apply. 


Theorem 9.36. A necessary and sufficient condition that s,(x) con- 
verges to s is that, for some 6 (where 0 < 6 < 7), 


oe 
i sin (n+4) sn 
0 u 
tends to 0 as n tends to «., 
Proof. 


Dj etbe = sin @+9u( sama} 
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and the expression in curly brackets, being O(u) as u + 0, is integrable 
over [0, 6]. Hence, by the Riemann-Lebesgue theorem 9.31, 


[ ' sin(n ul a ie -{, D,(u) $(u) du 


tends to 0 as n tends to neg 
The proof of theorem 9.35 shows that the condition stated in 
the present theorem is equivalent with that of theorem 9.34. | 


9.4. Convergence of Fourier series 


Theorems 9.34 and 9.36 can be transformed into a variety of 
shapes; two are given in theorems 9.41 and 9.42. The first form is 
very easily deduced from theorem 9.36; the second also is in common 
use. 

Since the value of f can be changed arbitrarily at a point without 
alteration of the Fourier coefficients, any condition of convergence 
of s,(x) to f(x) must take account of values of f not only at x but 
in a neighbourhood of x. (Continuity of f at x would be such a 
condition: we shall see in theorem 9.51 that it is not, in fact, strong 
enough to entail convergence.) 


Theorem 9.41. (Dini.) A sufficient condition for the Fourier series 
of f to converge to s at x is that the integral 


fea 
0 u 


exists (in the sense of tim [ ) b 
10d 4 


Proof. Given ¢, choose 9 such that 


[ela <€é 
Out 


Then, for all , 
ik sin n+putOa < feolan <6 
0 u ou 


By the Riemann—-Lebesgue theorem 9.31, there is n,(e) such that 


f° sin (n+ 3) a <e if n>. 


These two inequalities combine to give the sufficient condition of 
theorem 9.36. | 
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Corollary. If f is differentiable at the point x, then the Fourier series 
of f converges at x to f(x). The conclusion remains true under the more 
general hypothesis that, for some « > 0, 


|f(x+h)—f0)| = O(|h|*) 


as h tends to 0. 
Proof. With ¢(u) = f(x+u)+f(x—u)—2f(x), we have as u>0, 
|P@)/u| = O(|ul2) 


and the integral in the theorem exists. | 


Theorem 9.42. (Jordan.) If f is of bounded variation in a neighbour- 
hood of x, then the Fourier series of f converges at x to 


Hf(x+)+f(e—)}- 
Proof. In theorem 9.36 write 
s = Hf(x+)+f@—)}. 


(These limits exist by theorem 6.43.) 

Then ¢(u) has bounded variation in an interval [0, 6] say, and ¢(u) 
tends to 0 as wu tends to 0. 

By theorem 6.43 ¢(u) may be expressed as the difference of two 
increasing functions, each of which tends to 0 as u +0. 

The theorem will follow if we prove that, if ¢(u) is increasing, the 
integral in theorem 9.36 tends to 0 as n + 00. 

Given €, choose 7 so that ¢(7) < ¢. By the second mean value 
theorem 6.93 there exists a number £ such that 0 < & < 9 and 


fe (n+ 3)U au) ao oo [= ie 2)U 4, 


0 u 


= 4) [oa 


where a = (n+4)&, b = (n+4)7. This last integral is bounded for all 
n, &,, and so the last line is numerically less than Ae. 
By theorem 9.31, there exists m) such that 


fs (n+ DU su)du 
s 


u 
So the integral in theorem 9,36 is numerically less than (A +1)e if 
n> no | 


<e if n>. 
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The Gibbs phenomenon. Suppose that the Fourier series of a 
particular function f, which has discontinuities, is known to converge 
to f. We shall probe the manner of approach of the continuous curve 
y = s,(x) to the limit curve y = f(x), as n tends to infinity, in the 
vicinity of a discontinuity of f. The characteristic behaviour is seen 
most clearly if we make the simplest possible choice of /, namely 


f(x) = -40 if -17< x <0, 
Sx) = 4m if O<x<a, 
Shas period 27 and f(n7) = 0 for all n. 
The Fourier series of f, which is found to be 
2(sin x +4 sin 3x+4 sin 5x+...), 


converges to f(x) for all values of x, by theorem 9.42. 

It will appear in theorem 9.43 that, if n is large, as x increases from 
the discontinuity 0, the curve y = s,(x) rises at a steep gradient to a 
maximum value b,, at x = 7/2n. We shall prove that 5,, is approxi- 
mately, not 47 as might be expected, but the number 


feta, 
0 


which is about 18 per cent greater than 47. This phenomenon of 
‘overshooting the mark’ is named after Gibbs (see a historical note 
at the end of the chapter). As x increases beyond the value 77/2n, the 
sum s,(x) will have a sequence of minima and maxima alternately 
below and above the line y = 47. Since s,(x) = s,(7—x), the curve 
y = s,(x) for 37 < x < 7 is the mirror image in the line x = 37 of 
the curve for 0 < x < 37. 


Theorem 9.43. With the notation of the last two paragraphs, 


lim b, -[s Sint 
0 


noo 


Proof. 
si(x) = 2(cos x+cos 3x+ ... +c0s (2n—1)x) 
_ sin 2nx 
© (sles 


Therefore Sn(X) ={" sin 20 at 
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s,(x) has maxima or minima when sin 2nx = 0, that is, when 
2nx = rm. Insertion of these values in s;(x) shows that odd values 
of r give maxima and even values minima. 

At the first positive maximum x = 7/2n, 


S,(x) = 2 [sin Ha +5 sin ae a tah jsin Gna 
a; {= (17/2n) , sin (37/2n) % A sin (2n— ad 
—n\ an 37/2n a (2n—1)m/2n 


This is seen to be an approximative sum to the required integral if 
we dissect [0, 7] into n equal parts and take the value of (sin #)/t at 
the mid-point of each part. | 


The reader will expect the Gibbs phenomenon at a discontinuity 
to be shown by the Fourier series of a wide class of functions. In 
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order to define such a class we need further knowledge about the 
Fourier series of continuous functions. This will be found in the next 
section, in particular in theorem 9.54; see, then, exercise 9(c), 2. 


Exercises 9(5) 
1. Prove that the function defined by 


f(x) = Iflog |x|“) @& + 0), 
f@ =0 


satisfies at x = 0 the condition of theorem 9.42 (Jordan) but not that of theorem 
9.41 (Dini). 


2. Construct an example in which Dini’s condition is satisfied but not Jordan’s. 


9.5. Divergence of Fourier series 


Theorem 9.51. The Fourier series of a continuous function may 
diverge at a point. 


Proof. Define 
n sin rx 


t(x, m,n) = 2 sin mx y 
r=1 


(m>n> 0). 


We proved in §9.2, example 4, that the sum on the right-hand side 
is bounded for all x, . 

Hence ¢(x, m, n) is bounded for all x, m,n. 

Now ¢(x, m, n) is the cosine polynomial 


cos (m—n)x , cos(m—n+1)x cos (m—1)x 
= “toe + 
n n-1 1 


_cos(m+1)x_cos (m+2)x_ _cos (m+n)x 
1 3 _ z 3 


Although ¢(x, m, m) is bounded, nevertheless, at x = 0, the sum 
of the first terms (or the last ) is numerically greater than log n. 

Take two sequences of positive integers m, and n, with n, < m,,and 
a convergent series = a, of positive terms. Then, from the bounded- 
ness of #(x, m, n), the series 


cy 


X 4, U(X, My, My) (9.51) 


r=1 


converges uniformly for all x to an even continuous function, say 


SQ). 
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If, for all 7, M, +N, < Mp xy —Nyprs (9.52) 


then the multiples of x occurring in ¢(x, m,,n,) and t(xX, Mpi45 M41) 
are all different. 

The series (9.51) is of the form 2 A, cos vx. Since the sequence of 
its partial sums, when the terms are bracketed as in (9.51), converges 
uniformly, we can multiply by cos vx and integrate term by term 
over [—7, 7]. 

Every integral is 0 except that of the vth term where 

m,—-n, < ¥ < m,+n, 
and we have a 
mA, -{ I(x) cos vx dx. 


The series 2 A, cos vx is the Fourier series of f and its partial sums 
satisfy the inequality 
1 


1 
Sn(0) = a(1+5+ ore +3) > a, logn,. 


If m, = 2n, and n,,, > 3n, then (9.52) is satisfied. We have 
S(O) > 4a, log m, 
and the theorem will be proved if a, log m, tends to infinity with r. 
To ensure this we may take a, = 1/r? and an even 
m, > max (3m,_, exp r?). | 


The above construction, due to Fejér, defines a continuous 
function whose Fourier series diverges for a specified x. Continuous 
functions can be constructed whose Fourier series diverge for 
infinitely many x. 


Theorem 9.52. At a point of continuity x of f, we have s,(x) = o(logn). 
This statement is the best possible. 


Proof. With the notation of theorem 9.36, we shall prove 


i sin (n+4)u 20 ay = o(log n). 


Take s = f(x); then d(u) + 0 as u > 0, Given «, there is 7 (less than 1) 
such that |d(u)| < efor 0 < u < 7. Choose n greater than 1/7. 
Divide the range of integration [0, 7] into the parts 
(0, 1/m], [1/n, 7], [7,7] 
and call the corresponding integrals /,, J, Js. 
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In J, sin (n+4)u < (n+4)u and so 


In} < +a) falda < (1+3,)¢ 


Also |e] < € a < elogn, 
In 


I, = o(1) by theorem 9.31. 


Adding, we have s,(x) = o(log 7). 

To say that this limitation on s,,(x) is the best possible means that, 
however slowly y(n) decreases to 0, there is a function f for which, 
at some point of continuity x, s,(x) is not ofy/(n) log n}. 

This is already contained in the construction of theorem 9.51. 
We have only to impose the additional condition on m, that 
w(m,) < 1/r?. 

Then s,,(0) > 3a, log m, > 44/(m,) log m,. | 


Fourier series, even if divergent, are not useless. Surprisingly, any 
Fourier series can be integrated term by term. 


Theorem 9.53. If a, b, are the Fourier coefficients of f, then 


4ayx+ Zz 
n= 


Proof. Write 


a, sin met hell —cos nx) -{; f(t) dt. 


F(x) = | ‘ ‘f() dt—4ayx. 
Then F is continuous and of bounded variation. Also, since 


r+2n 
F(x +27) — F(x) -{ f(t) dt—ay7 = 0, 


F has period 27. 
By theorem 9.42, the Fourier series of F converges to F(x) for all x. 
The Fourier coefficients 4,, B, of F are 


2m 
. =if F(x) cos nx dx 
m™J0 


sin nx 


i 0 -iel, "(fle — day} sin nx dx 


-7/Fo™ 


1 2" . Dn 
Tf, F(x) sin nxdx = =a 
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and 
2m 
B= I F(x) sin nxdx 
T™J0 
aie Cos7r [an laies 4 
i F(x) = ik +2, {f(x) — fa} cosmxdx 
Ey a 
= al, I(x) cos nxdx = rt 
=e <7 4m Sin NX — by, COS NX 
So F(x) 2Ao+ & Se 
Putting x = 0, we have 2 
4-5-2. | 


Corollary 1. The series = (b,,/n) converges. 


Corollary 2, An everywhere convergent trigonometric series need not 
be a Fourier series. 


Proof. By the example following theorem 4.54 (p. 91) 


© sin nx 
n=2 logn 


converges for all x. If this were a Fourier series, then, by corollary 1, 
=. 1 
n=2nlogn 


would converge, which is false. | 


Theorem 9.54. In theorem 9.53 the series on the left-hand side 
converges uniformly for all x. 


Proof. Write B,(x) = 6, cos nx—a,, sin nx. 
We shall show that B,,(x) is the coefficient of sin nt in the Fourier 
series in ¢ of f(x+?). 
We have 
7 me é 
| fe-+0 sin ntdt = f(t) sin n(t—x) at 
iol —nt+e 
= | ” 4(t) sin n(t—x)at 


= cos nx” S(t) sinntdt —sin nx" S(t) cosntdt. 
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Dividing by 7, we have the result. (Similarly 
A,(x) = dp, sin nx +b, cos nx 


is the coefficient of cos nt in the Fourier series in ¢ of f(x+t).) 
Now we have to prove that © B,,(x)/n converges uniformly. 
From the first part of the proof, 


5 22) Bo) -i/" fx +5 nay 


r 
il 
pach +1,+1s), 
where the /’s are the integrals taken over [0, 6], [3, 2 —6], [27 —6, 27]. 
We know that, for all x, ¢, 
[fx+o)| <A 
and, from example 4 of §9.2, for all 7, s, t, 


s sin nt 
an 


< B. 


Hence each of |J4], |J| is at most ABé, and is less than a given € 
by choice of 6. Now & (sin nt/n) converges uniformly for 


d<t < 21-6, 
Therefore we can find ro such that 


8 sin nt 
Tr n 


for s > r > ro andiall t in [d, 27-6]. We have then |J,| < 27Ae and 
B,(x) 1 ) 
x = | <2¢ (+4 cl | 


Exercises 9(c) 
1. Deduce from theorem 9.53 an alternative proof that two different continuous 
functions cannot have the same Fourier series (cf. theorem 9.12). 


2. Prove that the Gibbs phenomenon holds at x = 0 for the function g = {i+/i, 

where e 

AG) = f f(t)dt, f being any integrable function, 
0 


Ax) = —kin(-—7,0), kin(@,7) (k > 0). 


320 FOURIER SERIES [9.6 


9.6. Cesaro and Abel summability of series 
Consider the infinite series 


1-14+1-1+1-.... 
If s, is the sum of the first n terms, 
S, = 1 (n odd), S, =0 (even). 
The average (arithmetic mean) of the sums s,, is 


_ Sy a tSq 
n 


1 1 1 
and o, = 3(t +1) (n odd), T= 5 (n even). 


n 


Thus o,, tends to 4 as 7 tends to 00. 

In the passage from s,, to o,, oscillations have been ironed out by 
cancellation of positive and negative terms of the original series. 
With increasing n the trigonometric functions sin nx and cos nx go 
through positive and negative values, and it is plausible that averag- 
ing the sums of a divergent trigonometric series may result in a 
convergent sequence. 

This section will deal with series of constant terms. In §9.7 we 
shall discuss trigonometric series. 


Definition. Let s, = u,+Ug+ ... +u, and 
im SytSat oe +S 
n 
Then o;,, is the (C,1) mean of the s,, and, if 7, tends to 1 as n tends to 
; o 
infinity, we say that > u,, is summable (C, 1) to /. 
n=1 


C refers to Cesaro (1859-1906). More generally a (C, k) mean can 
be defined; if k is a positive integer it is essentially a k-times repeated 
average. We shall confine ourselves to the case k = 1. 


Theorem 9.61. If & u, converges, it is summable (C, 1) to the same 
sum. 

We omit the proof which is a straightforward exercise on limits (see 
exercise 4(b), 9(i)). 


Theorem 9.62. If =u, is summable (C,1), then s, = o(n) and 
U, = O(n). 
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Proof. The first conclusion follows from 
Sp = NT, —(N—-1)on4, 
and then the second from 
Un = Sn-Sn—-v | 


Theorem 9.62, a limitation on the magnitude of u,, states that if 
the terms of a series are too large, the Cesaro averaging is too weak 
to sum it. 

It is much less clear that if the terms of a series are too small, the 
(C, 1) method will not serve any useful purpose—it will apply only 
to convergent series. The next theorem states a limitation of magni- 
tude of u,, under which summability (C, 1) of u, implies convergence. 
It will not be needed in the rest of the book, but it is an excellent 
exercise in analysis. 


Theorem 9.63. (Hardy, 1910.) If u, = O(1/n) and Xu,, is summable 
(C, 1), then it converges. 


Proof. 

(a) We separate out two preliminary results (6), (c), in which the 
hypothesis u,, = O(1/n) is not used. 

(6) Let t, = u,+2u,+ ... +nu,. A necessary and sufficient con- 
dition that the series Zw, summable (C, 1), should converge is that 
t, = 0(n). 

This follows from f, = (n+1)s,—no,. 

(c) A necessary and sufficient condition that Zu, should be 
summable (C, 1) is the convergence of 


th 
Dame)’ 


This follows from 
Bei ae Ms ea eel 
nn+1) n+l" 27 
(d) Using (6), (c), we prove the theorem. Suppose that Du, does 
not converge. From (5), there is a positive A such that either 
ty > AN or ty < —AN 
(assume the former) for infinitely many N. 
Now, for any n, 
fav = tnt (14+ Dt > tn-B, 
since u, = O(1/n). So, if ty > AN, we have ty,, > AN— Br. Then 
tysp > BAN if r < $AN/B. 


ee 
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Therefore 


te > g4N De ee 
v AGT) S Yay? N+r+l1° 
If we take r to be the integer next less than 34.N/B, we have 
N+r be fo 
x n(n+1) ‘ 


where C depends on A and B but not on N. Hence the series 
=1,/n(n +1) diverges and by (c), Su, is not summable (C, 1). | 


There are many methods of ‘summing’ series besides that of taking 
arithmetic means. If the reader will turn back to theorem 5.47 (Abel’s 
limit theorem) he will realize that the damping factors r"(r < 1) 
suggest another method. 

Definition. If, as r >1-, 


o 
x u,r” > 1, 
n=0 
then we say that >) u,, is summable (A) to /. 
n=0 
Theorem 5.47 shows that every convergent series is summable (A). 
Illustrations. The series 
1-1+1-1+... and 1-—2+3-4+5-... 
are summable (A) to 4 and } respectively. 
We shall prove that (A) is a more powerful method of summation 
than (C, 1); that is to say, any series which is summable (C, 1) is 


summable (A). Moreover there are series which are summable (A) 
but not summable (C, 1); such a series is 


1-2+3-4+5-..., 
which has just been mentioned. 
Theorem 9.64, A series which is summable (C, 1) is summable (A) to 
the same sum. 
Notation. We shall take the series to be > Up, Starting with a term 
Uo, as is appropriate to summability (A). This entails a modification 


of the formulae for (C, 1) sums at the beginning of §9.6, where it was 
preferable to start with u,. We write henceforward 


Sotsit ... +5pa 
n 


-3u, and o, = (n> 1). 
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Proof. By theorem 9.62, u, = o(n) and so Zu,x" converges 
absolutely for0 < x < 1. 

By two multiplications of absolutely convergent series we have 
(Cl, theorem 5.7, corollary) 


(l-x)? > U,x” = (1 -x)>{ Sx" > u,3* 
0 0 0 
= Sx" Sis,.x" = Sno,x", 
0 0 1 
Therefore (supposing throughout that 0 < x < 1), 
> Unx” = (1—x)* > Nees 
0 1 


The binomial expansion of (1 —x)-* (or the substitution 


Up, =O (n> 1) 
in the last-line) gives is 
1 = (l—x)? Dax. 

1 


Multiplying this equation by / and subtracting from the one before, 

we have o © 

Du,x"-1 = (1—-xP? Dano, —) x". 

0 1 

Suppose that / is the (C, 1) sum of z uy. Then, given e > 0, there 
0 


is an N such that |o,—/| < eifn > N. Now 


o N Cy 
Du,x"-1 = d-o(3 +> ) neo, —Dx" 
0 1 N+1 


Inthis, | Sin(o,—-Dx" 
Nt+1 


<e > nx" < e(1—-x)7. 
N+1 
Keeping N fixed, and letting x > 1—, we have 


<6 


e 
lim sup | Du,x"-1 
aal- | 0 


Since ¢ is arbitrary, u,, is summable (A) to /. | 


9.7. Summability of Fourier series 
Theorems 9.51 and 9.52 are confessions of failure to determine a 
function as the limit of partial sums of its Fourier series. To a 
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physicist this would seem lamentable; the results of his observations 
in spectral analysis are the Fourier coefficients of the functions that 
he seeks, We are now in a position to show that, though the sequence 
of sums s,(x) may fail, the sequence of means ¢,,(x) succeeds in 
reconstructing a continuous /. This result of Fejér was a landmark 
in the theory. 
Definition, 
SAX)... +Sp—1(X) 

ie mee ps Samal) 

Note that the first suffix is 0, not 1. 


Theorem 9.71. For the Fourier series of f, 
ule) = ZI Ken (/Ce +1) +/(0—w} dy 


where the Fejér kernel K,(u) = sin? 4nu/2n sin? 4u. 
Proof. Using the Dirichlet integral (theorem 9.33) for s,, we have 


ox) =} ) a 


n7Jo\r=o 2 sin du 


1 ‘(33 (r+3)u 


|e +w) +fe—W)hdu (9.71) 


Sum the trigonometric series by the formula 


2 sin 4u sin (r+4)u = cos ru—cos (r+1)u. | 


Corollary 1. f " K,(u)du = 4. 
0 


The important property of the Fejér kernel K is that it is always 
positive (or zero), in contrast with the Dirichlet kernel which takes 
both signs. This fact yields inequalities such as the following: 


If m < Wu) < M, 
then jana J "Kw y(wdu < 4M. 
0 


The following corollary is analogous to theorem 9.34. 
Corollary 2. A necessary and sufficient condition that the Fourier series 
of f is summable (C, 1) to s at x is that 

T oin2 1, 
lim, 2 ("Ses 
no NJo sin? 4u 


where ¢(u) = f(x+u)+f(x—u)—2s. 


$(u)du = 0, 
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Theorem 9.72. (Fejér, 1904.) The Fourier series of f is summable 
(C, 1) to Hf(x+)+f(x—)} whenever this expression has a meaning, 
and in particular to f(x) at every point x of continuity. 
Proof. Putting s = 4{f(x+)+f(x—)}, we have $(u) > 0 as u> 0. 
Given e, there is an 7(< 7) such that |d(w)| < ¢ for |u| < 7. 
Dividing the range of integration [0, 7] at 7,,we have 


see c (ae 1 (* Lee 
inj o sin? 4u Pu) du) <>) Sint qu duo , sin? yu du. (9.72) 
The first term on the right is less than 

é (sin? 4nu 

ef. sin? 4u ie 


which is 7¢. The second term tends to 0 as n tends to 0. | 


Corollary 1. If f is continuous in an interval (a, b) anda < c < d<b, 
then o,(x) > f(x) uniformly in the sub-interval [c, d]. 


Proof. Given ¢, there is 7 independent of x such that, for all x in 


- [Yor+u)-f)| <4 if |u| <2. 

Hence |¢(u)| < ¢ if |u| < 7, which is the estimate required for the 
first term on the right in (9.72). Also |d(u)| < A, a constant inde- 
pendent of x, u, and the second term on the right of (9.72) is less 
than B/n. | 


Corollary 2. (Weierstrass’s approximation theorem for trigono- 
metric polynomials.) ff is continuous and has period 2m, then given ¢, 
there is a trigonometric polynomial t(x) for which | S(x)—-t(x)| < € 
for all x. 

This is the analogue of theorem 5.52 for algebraic polynomials. 
See also exercise 5(f), 2. 


Summability (A) of Fourier series. 
Lemma. If 0 <r < 1, then 


oO -p 

(i) 4+ Ph cos n@ = wiwarous D4r) 

(ii) for fixed r, the series converges uniformly in 0. 
Proof. (i) Writing z = re”, we have ; 

1-re-# 


ed 1 
SU gece earls eee 
a+ od l-z 4 1—2r cos 0+7? 2. 
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We now take real parts. 
(ii) |r” cos nO| < r” and Zr” converges. 
Uniformity follows from theorem 5.32 (M-test). | 


Theorem 9.73. If f(x) has Fourier series > A,(x), then, forO <r < 1, 
0 


wa 1-f oii 
2) —, 1—2r cos (t—x)+r* rs 


¥ A(x)" 
0 


Proof. From the lemma, 
1-r ; 
2(1 —2r cos (t—x)+7r*) 
We can now multiply by the bounded function f(r) and integrate 
term by term over [—7, 7]. | 


=4+ Sen cos n(t— x). 
| 


The left-hand side in theorem 9.73 is called the Poisson integral 
off. 
Theorem 9.74. 


lim 5 (i Wate: 
roi- 27J —, 1—2r cos (t— 


yep Odt = Hfle+) +S) 


whenever the right-hand side has a meaning. In particular the right- 
hand side is f(x) at every point x of continuity. 


Proof. By theorem 9.72, 5 A,(x) is summable (C, 1) to 
0 


Hf(x+) +f}. 


By theorem 9.64, it is summable (A). Theorem 9.74 then follows from 
9.73. | 


Exercises 9(d) 
1. The power series Za,z" has radius of convergence R. Can it be summable 
(C, 1) for a value of z with |z| > R? 
For what values of z is the geometric series £2" summable (C, 1)? 
Define uniform summability (C, 1). Specify a set of z in which Ez" is uniformly 
summable. 


2. Prove that the summability (A) of Sa, implies its convergence if 


either (i) a, >0 forall n, 
or (ii) a, = o(1/n) (Tauber). 


(The much deeper result with O in place of o in (ii) was proved by Littlewood.) 
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3. Adapt the proof of theorem 9.64 to prove the following theorem. Suppose 
that (i) Ed, is a divergent series of positive terms, (ii) Zd,x" converges for 
|x| < 1, (iii) as n + 00, lim (c,/d,) = k (+0). Then, as x >1—, 


Senx" 
Xd,x" 


A x x 
se (2) 


is a suitable definition of (C, 1) i S(x)dx. 
0 


+k. 


4. Satisfy yourself that 


0 
Prove that j x* sin x dx exists in the (C, 1) sense if 0 < k <1. 
0 


0 
Can you suggest a definition of summability (A) of S(x)dx? 
0 


9.8. Mean square approximation. Parseval’s theorem 
We saw in §9.5 that, for some functions f, the Fourier sums s,, give 
poor approximations to fin the sense of the metric 


sup |f(x)—s,()|. 


—a<a<n 


Indeed at particular points x the difference | f(x)—s,(x)| may tend 
to infinity with n. 

We shall show in this section that the sums s,, give good approxi- 
mations to fas measured by 


[7 eo-scatas. 


Among all trigonometric polynomials f, of degree at most 7, the 
Fourier sum s,, minimizes the integral 


fo-ny. 


This property is shared by expansions in sets of functions other 
than trigonometric functions. It is easier to write out a proof under 
general conditions. 


Orthogonal and orthonormal sets of functions. 


Definition. The functions ¢, for n = 1,2, ..., Riemann integrable 
over [a, 6], form an orthogonal set if 


F/$m(9)aGxdee = 0 (m + m) 
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If, in addition, 


J @.coar i (ral; 25); 
the set (or system) ¢,, is orthonormal. 
Definition. The number " 
en = [ forenla)ae 
is the n-th Fourier coefficient of f for the orthonormal set 6,, and 
Sends 
is the Fourier series of f. We write s, = a dre 


The trigonometric functions 


1 1 Digs: 
Arai 12 SOS tn, eee nx 


Jen mn 


form an orthonormal set in [—7, 7]. 
Theorems 9.81 and 9.82 will be stated for a general orthonormal 
set ¢,, in [a, 5]. 


Theorem 9,81. If t,, = z d,¢,, then, for fixed n and arbitrary d,, the 
1 


integral 


'b 
fiteo-109}8ax 
b 
attains its least value when d, = c, -{ S(x)¢(x)dx forr = 1,2,...n. 


Proof. All integrals are over [a, 5] and all sums from | to n. 


for-me- [oso 2 -2f f+ 2+2[frn—[ sh 


= —23¢,d,+5d?+25e-Te 
= X(c,—d,)*. 
The sum is never negative and is 0 only when ft, = Sas] 


Theorem 9.82. (Bessel’s inequality.) 
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Proof. We showed in the proof of theorem 9.81 that, for all n, 


furs = [r- Ee. 
The left-hand side is not negative. | 
Corollary 1. In the trigonometric case 
iat Baroy <i" 
Corollary 2. Asn -> ©, Cc, > 0. 


The trigonometric case of Corollary 2 (a, 0,5, 0) was 
proved differently in theorem 9.31. 

For some (not all) orthonormal sets the inequality in theorem 9.82 
can be strengthened to equality. This is true for the set of trigono- 
metric functions and we proceed to prove it. The most direct argu- 
ment depends on Fejér’s theorem 9.72. 


Theorem 9.83. (Parseval’s identity.) If the a, b, are Fourier coeffici- 
ents of f, then 5 1p 
dat Sai+ey =2[" p 
n=1 NJ —a 
Proof. We have as in theorem 9.82 (for trigonometric functions) 
‘0 k 7 
o<f” p—a{sag+ Scat+09} = [7 F-s08 
= 1 —n 
From theorem 9.81, if t,, is a polynomial of degree n, and k > n, 
7 7 
[ges < [7 r= 
Theorem 9.83 will follow if, given ¢, we can find a ¢,, such that 
[ig -10? < Ke, 


where K is a constant which may depend on f. This we set out to do. 
(i) If f is continuous, by theorem 9.72, corollary 1, there is a 7, 


for which | £2) —o,(2)| < J(6/2m) for all x. 


Hence we have i (f-¢,)? < €& 
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(ii) Assume only that f is integrable. With the usual notation, 
there is a dissection of [—7, 7] for which 


N 
2 (M,—m,)(x;—%j-) < € 


Define a continuous function ¢ such that 
P(xi) = f(x) for i=0,1,..., N, 


and ¢ is linear in each [x;-, x;]. Then, all the integrals being over 
[-7, 7], 


|\f-9| < 2(M,-m)(%-x-4) <6 
so that, if M = sup |f(x)| > sup |d(x)|, 
furor < fam ies] < me. 
Since ¢ is continuous, there is by (i) a trigonometric polynomial ¢ for 


which 
| (d-tP <e. 


From the inequality (a+b)* < 2(a*+5?) we have 
freon < 2fr-ar+2f@-08 
< (4M+2)e. | 
Exercises 9(e) 
1. If (a,, b,) are the Fourier coefficients of f and (cp, d,) those of g, prove that 
i [ve = 4ageo+ E(ones+ Pad) 


2. By Parseval’s theorem or otherwise prove that 
Co a 2 = 1 7 
B= 90° & Gai = 960" 
3. Prove that, if k + 0, 


s 1 _ 3+k*1?—3kn coth kn 
T m(n?+k*) 6k* 


9.9. Fourier integrals 

We now attempt the analysis into harmonic components of a 
function f defined for —co < x < o, which possesses no periods. 
This analysis will involve an integral in place of a series. 
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The requisite integral was discovered by Fourier himself from the 
following heuristic argument. Suppose that f has period 27A (where 
A will later tend to infinity) and that its Fourier series is 


= nx . AX 
3a +a (a, cos + b,, sin *) 3 


if mr 
where a= f ™ flat 
Lie nt 1 pr ont 
and a, =} ik " LOeos tat, by = 5 | * fo sin eat, 
Write i7 Up, and t= du, so that 


ah 
a, = a J F S(t) cos u,tdt (and b,, likewise). 
Let now A > oo and we conjecture that 


fx) = ‘i {a(w) cos ux+b(u) sin ux}du, 
where 
A= i on Hien, Bae tT. f() sin utdt, (9.91) 
or, finally, Le oe 
fy =1 di f * _F{@) 008 u(t —x)dt. (9.92) 


To inject rigour into Fourier’s analysis would be troublesome. 
Instead, we start afresh and investigate the formula (9.92) on lines 
parallel to those which guided us in §§9.3, 9.4. 

Throughout §9.9 we make the assumption that [ | f( | dt exists. 
Then the integrals in (9.91) exist for all values of u and the inner 
integral in (9.92) exists for all u, x. Moreover (by theorem 6.35) the 
convergence of the infinite integrals in (9.91) is uniform with respect 
to w for all u. 

The reader will prove without difficulty (exercise 9(f), 1) that 
a(u), b(u) are continuous functions of u. 

We first extend theorem 9.31 (Riemann-Lebesgue). 


Theorem 9,91. If is | f(x) | dx exists, then 
lig F(X) cos Axdx +0 and é F(x) sin Axdx +0 


asi>o., 
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Proof (for the cosine integral). Given e, there is X such that 


—X co 
fluiefi ifs 
-«o x 
By theorem 9.31 there is Ag = A(X, €) = Ao(e) such that 


x 
i) PAC) cos Axds| <e for A>Aj. 


Hence ie F(x) cos Axx) <2e for A>Aj | 


The next theorem is the counterpart of theorem 9.33 (Dirichlet’s 
integral). 


Theorem 9.92. 
ie dul S(t) cos u(t—x) dt = -{". f@ ——— 


Proof. The inner integral on the left converges ee in u. 
Hence, from theorem 8.74 (the hypothesis (i) of which is satisfied 
from exercise 8(c), 2), the left-hand side is equal to 


co U 
iE fide cos u(t — x) du, 


which is the right-hand side. | 


sin He sin U(t—x) oD 


We now define $@) =le+)+fG—)=2s 
and follow the steps leading from theorem 9.33 to 9.34 and 9.35, 
obtaining two theorems. 


Theorem 9.93, A necessary and sufficient condition that 
rhode F/G) Costati aan) dire 


sin ut 


is that iim |, ree t) dt =0. 
Proof. z 
Ie f0) sin se sin U(t—x) 4, _ -[ xt) +f(x-9} sin Ly | 


-f. Pi Ctat+2s) sin Ut y 
0 t 0 t 


and this last integral is 47 from §8.7 (exe-ple). | 
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Theorem 9.94. (Localization theorem.) The convergence or diver- 
gence as U > © of the integral 


U pe 
i, du S(t) cos u(t —x)dt 
depends only on the values of f in an arbitrarily small neighbourhood 
(x—46, x+6) of x. 
Proof. Following the proof of theorem 9.35, we decompose 


fr roto +fe-9} 


sin OT at 


8 oO 
into f +f . The function | f(x+1) +/f(x-1)|/t is integrable in (6, 20), 
0 é 
because | f| is integrable in (— 00, 0). By theorem 9.91, 
sin Ut 


ii (feet + feo at 


tends to 0 as U tends to ». 
Therefore, as U > ~, 


U O 
du F() cos u(t — x) dt 
0 -~ 


and (i du ie f(t) cos u(t — x) dt 


both converge to the same limit or both diverge. The latter integral 
depends only on the values. of f in (x—6, x +4). | 


We are now in a position to write down the criterion for integrals 
analogous to that of theorem,9.36 for series. 


Theorem 9.95. A necessary and sufficient condition that 
if du” f(t) cosu(t—x)dt = s 
0 -© 


is that, for some 6 > 0, 


jim nf d(t) 


sin a 


dt = 0. 
Proof. 


foo ar = [Pero +fe-o% 


sin Ut Hie 25(= sin Ut 4 
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The first integral tends to 0 as U + co by the proof of theorem 9.94. 


ate 
The integral in the second term is i ode, which tends to 0. | 
ve 


Theorem 9.95 shows that the Fourier integral of f converges at a 
point x if f (restricted to an interval containing x) satisfies any known 
set of sufficient conditions for the convergence at x of its Fourier 
series, for instance those in theorem 9.41 or 9.42. 


Fourier transforms. Suppose that f is defined on [0, 00), Let f, be 
the even function on (— 00, 00) coinciding with f on [0, 00). From 
equations (9.91), 


a(u) = A Fd) cos utdt = z "I S(t) cos utdt, 
1) 0 T7Jo 
ba) =+ i) ” f(t) sin utdt = 0. 
If now f, as well as being absolutely integrable over [0, 00), satisfies 


at x sufficient conditions for the convergence of Fourier series (such 
as Dini’s or Jordan’s) we have 


fs) = i . a(u) cos uxdu. 


The formulae for a(u) and f(x) become quite symmetrical if we 
adjust the numerical multiplier and write 


a(u) = (2) S(t) cos utdt, 


Pe to 
I(x) = (") i} a(u) cos uxdu. 
7, 0 
Two functions such as f(x), a(u) linked by this reciprocal relation 


are called cosine transforms of each other. 
Similarly an odd function gives rise to a pair of Fourier sine 


transforms Pp 
S@ = (=) i, b(u) sin uxdu, 


where btu) = (2)' i, SF(d) sin utdt. 


It is in the shape of transforms that Fourier integrals are most 
readily used. 
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It will be observed that, though the formulae are symmetrical, the 
properties of the functions f(x) and a(u) (or b(u)) differ. To attain 
further symmetry it is necessary to use the Lebesgue integral. 

Transforms according to other definitions (notably Laplace trans- 
forms) are also important in analysis and in mathematical physics. 


Exercises of) 
1. Prove that, in (9.91), the functions a(w) and b(u) are continuous. 


2. Find the function b(u) satisfying the integral equation 
f@) = ib b(u) sin uxdu (x > 0), 
0 


given that, forx > 0, f(x) is 
@ 1 for O<x<a7, 
0 for x27, 
Gi) e*, 
(iii) xe-**, where k > 0. 


3. Prove that, if b > 0, 


COS ax 7 
—_— = —e- i 
jf Pore id ap? techie 0 


What is the value if a < 0? 


Further exercises on Fourier and Laplace transforms are in 14(a), 16-19, 
when results obtained by complex integration are available. 

The reader may verify that the complex-exponential version of Fourier 
transforms (in the sense of the note at the end of §9,1) is, with the same hypotheses 
on f as for cosine or sine transforms, 


elu) = (z)' [i poem dt, 


fis) = (2) f * ee de 


NOTES ON CHAPTER 9 


§9.1. (History.) The physical problem which impelled the study of trigono- 
metric series was that of the transverse vibration of a string, with ends fixed at 
the points (0, 0), (/, 0). Mathematicians of the 18th century were in possession 


of the differential equation 
oe er. 
ae aa (c constant) 


satisfied by the configuration y = y(x, t) of the string, Here (0, t) = y(/, t) = 0 
for all t. 
In 1747 d’Alembert, by the change of variables 


€=x+cet, 1 =x-ct, 
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r ay 
transformed the equation to aEeq =0, 
which is satisfied by y= $6) +¥) 


= &(x+ct)+y(x—-ct), 


where the arbitrary functions ¢, y are to be determined by the initial shape and 
motion of the string. Suppose, following d’Alembert, that, when ¢ = 0, the 
string is at rest in the configuration y = f(x) for 0 < x < /. Then 


OQ) +H) = fQ). 
Since the velocity at every point is 0 when ¢ = 0, 
cf'(x)—cyr'(x) = 0, 
and this can be integrated to give 
$(x) = W(x). 
In this way d’Alembert was led to the solution for 0 < x < /and all positive 1, 
y = 4f(x+at)+4f(x—ar). 


At about the same time, Euler made a similar analysis of the problem. The 
two men differed, however, in their concept of a function. Was an analytical 
expression required (as d’Alembert held) or was a specified graph an adequate 
definition (Euler)? Essentially, d’Alembert’s notion of a function was too narrow 
(needing in his hands derivatives of every order) and Euler’s was too vague. 

In 1753, Daniel Bernoulli used the method of separating variables to find 
particular solutions y = u(x) v(t) of the wave equation. The equation is satisfied 
by u(x) = sin px or cos px, and v(t) = sin pet or cos pet, where p is a constant. The 
condition »(0,t) = 0 (all t) excludes cos px, and the condition y(/,t) = 0 
restricts p to the values n7/I. 

Since the equation is linear, particular solutions may be added to give 

« 
y= > sin wisi (a. C08 he sin) 8 
nal i 1 1 
Assume, with d’Alembert and Euler, that when ¢ = 0, the string is at rest in 
the form y = f(x). We have b, = 0 (all n) and 
~ 
yx, 1) = Y a, sin LEK cog tens 
n=1 / 1 
Bernoulli asserted this value of y(x, t) to be the general solution and so it had to 
include the d’Alembert-Euler solution. This implied (for ¢ = 0) that an arbitrary 
function f(x) in [0, 7] could be expressed as 


© 
> a, sin nx, 
n=l 
but this was unacceptable to both d’Alembert and Euler. 
The 18th century mathematicians summed a number of infinite trigonometric 
series, and their results, though lacking rigorous proof, were often right. As 
instances, Euler stated that 


sin x—4 sin 2x+4 sin 3x-... 
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had sum 4x, but apparently believed this to hold for all x instead of for 
—7 < x <7 only. Bernoulli gave the sum 4(7—.x) for 


sin x+4 sin 2x+4 sin 3x+..., 


with the correct range of validity 0 < x < 27. 

The next advance came in 1807 when Fourier proved in many special cases 
that a function f/, which might have discontinuities, could be expanded in a 
convergent trigonometric series. Proofs of the possibility of expanding a general 
function were attempted by Fourier himself, Poisson, and Cauchy. Fourier’s 
contributions were recognized by the attachment of his name to the trigono- 
metric series associated with a given function. The first real proof that a wide 
class of functions could be expressed as trigonometric series is due to Dirichlet 
(1829). 

Since the days of the early 19th century analysts, the mutual interaction of 
trigonometric series with the main branches of analysis has been fruitful. As 
illustrations we cite (with names and rough dates) the topics of integration and 
differentiation (Riemann 1850), sets of points (Cantor 1880), functions of bounded 
variation (Jordan 1890), summability of divergent series (Fejér 1904), integration 
and differentiation (a second wave, Lebesgue 1900). If theorems about trigono- 
metric series are to be free from restrictions not inherent in the problems, it is 
necessary to interpret integration in the sense of Lebesgue. The Lebesgue integral 
is not included in this book, and in this chapter we do the best we can with 
integrals in the Riemann sense. 


§9.4. Gibbs pointed out the phenomenon in 1899. It had however been observed 
by Wilbraham in 1848. There is a good chapter, with illuminating diagrams, 
in Carslaw, Fourier Series and Integrals. 


§9.6. The student should read the historical account given in Hardy, Divergent 
Series, This contains a section on Fourier and his theorem (p. 29). 


10 
COMPLEX FUNCTION THEORY 


10.1. Complex numbers and functions 

The rest of the book will be devoted to a closer study of complex 
functions, namely functions whose domain of definition and range 
are both in Z, 

The function value f(z) will usually be called w, and we shall keep 
to the notation z=x+iy = r(cos 0+isin 0), 
w= utiv = p(cos d+isin ¢). 


Numbers such as a and b in w = az+b will in general be complex 
unless common usage proclaims their reality (as for u, v, p, @ above). 

The reader will be familiar with the definitions and properties of 
the conjugate, 7 = x—iy; the modulus, |z| = r = \(x*+y?); and the 
phase, the angle @ for which cos @ = x/r and sin @ = y/r, where 
r + 0. The phase has infinitely many values differing by multiples 
of 27. We shall write Phz (with a capital P) for any of these values. 
It is often convenient to have a principal value of Phz, and this is 
defined to be the value such that —7 < Phz < a, The principal 
value will be written phz with a small p. 

We write an equation such as 


Ph(z,2z,) = Phz,+Phz, 
as being true modulo 2n, that is to say, the two sides may differ by an 
integral multiple of 27. The reader may verify that 
ph(z,2.) = phz,+phz,+2kz, 
where k may be 0 or 1 or —1, depending on z, and 2. 
Writing w = f(z) as uti =f(x+iy), 


we see that this is equivalent to a pair of real functions of two real 


—_ u = u(x, y), v = v(x, 9), 


defined for a given set of pairs (x, y). This notion of a function of z 
is too wide to be the most useful. For instance, functions so defined 
cannot in general be differentiated if we define, as seems natural, 


S'(2) = lim (6w/éz). 
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Mlustrations. (1) w = 4(z+7), that is w = x, is a function of z in the sense that z 
determines w uniquely. But, in notation which explains itself, if dz has phase 0, 


ow 
oz 
and so the modulus of éw/éz takes all values between 0 and 1 according to the 
phase of 6z, and dw/dz does not tend to a limit as 6z + 0. 


(2) If, however, w = z*, then, as dz +0, dw/dz tends to the limit 2z. The 
reasoning is just like that which proves that, if y = x*, then dy/dx tends to 2x. 


ox 
oz 


= |cos 6], 


Usually the domain of definition of a function of z is a region 
(defined in §3.3 to be a connected open set). Continuity of f for a 
given z then means that lim f(z+h) = f(z) as A tends to 0 through 
complex values. 


Definition of derivative. If, for a given z, 
S(Z+h)-fe) 
h 


tends to a limit as h tends to 0, then f is said to be differentiable for that 
z, and the limit, written f'(z), is the derivative. 


Theorem 10.1. Necessary and sufficient conditions for f to be differ- 
entiable at a given point z are that u and v are differentiable (in the 
sense of 7.11) and their partial derivatives satisfy the Cauchy—Riemann 
equations 

Uy = Vy Uy = —U, 
at the corresponding (x, y). 


Proof. We prove necessity. Let f’(z) = p+ig. Write h = k+il. By 
definition of f’(z), 


SE+h-S@ = (p+ighk+il) + oe +P)}. 
Taking real and imaginary parts, we have 

u(x+k, y +1) —u(x, y) = pk—gl+ ofy(k* +19}, 

ox+k, y+l)—v(x, y) = gk +pl+ofi(k2+P)}. 
Hence u(x, y) and v(x, y) are differentiable in the sense of (7.11) or 
C1 (156) and 

d= P= ty = —G= —Y 

To prove sufficiency, we reverse the steps of the argument. | 


Notes. (1) Comparing the definition of f’(z) with that of the Jinear 
derivative A in (7.12) we see that the linear function A(A) is f’(z)h. 
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The connection between the mappings from Z to Z and from R* to R® 
is elaborated in a note at the end of the chapter. 

(2) In complex function theory the notation u, for the partial 
derivative @u/@x is more expressive than the general notation D,f 
which is best in chapter 7. 

(3) Taking 6z to be 6x and iéy in turn, we have 


fo = ZL =u,+io, 
and f'(2) = if = v,— iu, 
(4) If the first partial derivatives of u and v are differentiable 


(which by theorem 7.84, is a sufficient condition that uw, = uy,), then 
the Cauchy—Riemann equations show that 


Ugg = Ugy = —Uyys 


that is to say, u (and similarly v) satisfies Laplace’s equation in two 


variables au, iy _ A 
axi" aya 


Functions which satisfy this equation are called harmonic functions. 
They play a large part in both pure mathematics and physics. 


Manipulative properties of complex derivatives are in general 
straightforward adaptations of those of real derivatives, for instance 


d : , 
gZlis@} =Sis@}s'@). 
The following examples illustrate methods of solving some 


problems suggested by this section. 


Example 1. If, for all z in a region D, f'(z) = 0, then f is constant 
in D. 


Proof. By note (3) above, at every point of D, 
Uz = Uy = Uz = vy = 0. 
If the segment (x, y,), (x, 2) is in D, the mean value theorem shows 
a ux, Ya) U(x; ¥1) = Oa-P U(x, 1) = 0, 


where y; < 7 < yo. 
If a and b are any two points of D, they can, by theorem 3.32, be 
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joined by a polygon whose sides are horizontal or vertical. The above 
argument applied to u and v along these sides gives f(b) = f(a), as 
required. | 


This splitting into real and imaginary parts is necessary because 
(§7.3) Rolle’s theorem and the mean value theorem do not extend 
directly to a function from R? to R? (or from Z to Z). It is possible, 
however, to prove an inequality form of the mean value theorem on 
the model of theorem 7.31 (see exercise 10(a), 10). 


Example 2. Find f(z), differentiable for all z except z = 0, having 


real part xy 


uy* 


(which satisfies Laplace’s equation except for x = y = 0). 
Solution. The neatest way is to exploit conjugates, 


2u(x, y) = (ut+iv)+(u-iv) = f(2) +f. 
Writing 2x = z+Z and 2iy = z—Z, we have 


= z+Z—i(z—Z) _ Ieee alee 


2u = 
zz Zz z. 


Hence f(z) = i is a solution; and iA, where A is an arbitrary real 


constant, may be added to it. 


10.2. Regular functions 


In §10.1 we indicated that the existence of the derivative f’ is 
necessary if complex functions f are to have interesting properties. 
For instance, 


men az+b 5 =i 
Brrge ce oe 
are acceptable, the former being differentiable except for z = —(d/c) 


and the latter for all z. We shall investigate both of these functions 
in §§10.3-10.6. 

Suppose now that w? = z. Corresponding to a given z there are 
two values of w (if z + 0). We were faced with this ambiguity in 
discussing the relation y? = x between real numbers. We could then 
agree that y? = x comprises two separate functions, namely (for 


<0) y=+x and y= —,x, 
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and each of these could be investigated in its own right. From w? = z 
in complex variables the two values of w cannot be so readily dis- 
entangled, and the reader should go into the following details in 
order to appreciate this fact. 

Write 


z=r(cosO+isin#@) and w= p(cos¢+isin 4), 


where r > 0 and p > 0, Equating moduli and phases in w* = z, we 


have pi=r and 26 = 0+2nz, 


where n may be any integer. The values 


¢@=30 and ¢=30+7 
give two distinct values of w. Taking as an illustration the special 
case r = p = 1, suppose that 0 < @ < 27. Write 


Ww, = cos40+isin40, w, = cos (40+7)+isin (40+7), 


If z moves once round the circle |z| = 1, one of the two correspond- 
ing values of w moves from w, round to w, and the other from w, 
to Wy. 

In tracing the values of w we have for simplicity moved z round a 
circle with centre z = 0. The phenomenon of interchange of values 
occurs if z follows any path which winds round the origin z = 0. 

A point, like z = 0 here, about which values of w interchange is 
called a branch point. The different values of w (there being two in 
this illustration) generate branches. 

In order to define a function of z satisfying the relation w* = z, we 
must restrict the domain of definition to one which contains no 
path winding round the origin. Such a domain is the z-plane with 
the negative real axis (vy = 0,x < 0) deleted. We shall call this 
region the z-plane cut along the negative real axis. Any ray from the 
origin would serve equally well for the cut. If then w is defined to be 
(say) —1 when z = 1, the relation w* = z determines a continuous 
function of z in the cut plane. We shall meet another instance of 
multiplicity of values in §10.6 and we shall take the problem up 
more systematically in §13.3. 

When writing in the sequel w = f(z) we shall always understand 
that, for any z in the region (or set of points) contemplated, w is 
defined uniquely. 


Definition. f is regular in a region D if f'(z) exists at every point z 
of D. 
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Definition. f is regular at the point a if there is an open disc containing 
a in which f is regular. 

The reader will remark that the order of these definitions is 
opposite to that customary for real functions. In defining, say, 
continuity of a function /: R! > R', we first define continuity at a 
point x = a. Afterwards we define continuity in an interval to mean 
continuity at each point of it. The reason for the emphasis on a 
region is that (as we shall prove in the next chapter) differentiability 
of f(z) in a region entails the existence of higher derivatives as well. 
No such further implication holds for a réal function f(x). 

On the other hand functions regular in a region or at a point have 
most properties that our knowledge of differentiable real functions 
would lead us to expect. Regularity is preserved under algebraic 
operations; for example the quotient f/g of two regular functions is 
regular except at points where g vanishes. 


Illustration. If n is a positive integer, z" is regular for all z, z—" is regular for 
all z except z = 0. 


An extensive class of regular functions is formed by those defined 
as power series or known to be expressible as power series. We prove 
this. 


& 

Theorem 10.2. If the power series ¥, a,z” converges for |z| < R, then 
F ! ’ 

its sum f(z) is regular for |z| < R. Moreover its derivative f'(z) is 

Dd na,2"— for |z| <.R. 

1 


Proof. By theorem 4.62 the series Ena,,z"- converges for |z| < R. 
So also does the series, soon to be used, Un(n—1)a,z"—*. 
Fix z, and take € = z+h with 


|z|+|h| < R, < R 
We wish to prove that, as h > 0, 


Sa, Girne -Sina,z"1 +0. (10.21) 
0 1 


The coefficient of a, is 0 for n = 0 or 1, and for n > 2 is 
(Gr-2 + Or-8z + +271) — zn 


fear | 
= S enh ae = ape | 
p=1 


(6-2) = DPA(Ln-P-A4 Empty +, ZAP), 
Z 
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Since |z| < R, and |¢| < Rj, the modulus of the last line is at most 


n-1 
lhl x (n—p)Ri* = n(n 1) RA. 
oa 


Since > n(n—1)|a,| Ri-* converges, the left-hand side of (10.21) is 
2 
O(\h\). | 


Notes. (1) What we have proved is ‘complex differentiability 
term by term’ for power series. The proof of theorem 5.46 held only 
for differentiation with respect to a real variable. 

(2) Since all the series obtained by any number of term by term 
differentiations of a power series have the same radius of con- 
vergence, theorem 10.2 shows that a function represented by a power 
series has within its circle of convergence derivatives of every order, 
and they are all regular functions. 

It will appear in §11.9 that the property of possessing derivatives 
of every order belongs to all regular functions, whether defined by 
power series or in some other way. 

Theorem 10.2 shows, for example, that exp z, sin z and cos z are 
regular for all values of z. 

Terminology. Holomorphic (and also monogenic) is a synonym for 
regular. Some writers use the word analytic in the sense in which we 
have used regular; we prefer to reserve it to carry a wider meaning 
which will be explained in §13.4. 


Exercises 10(a) 


1. Establish necessary and sufficient conditions that 
(i) the points 2,, 2, Zs are collinear; 
(ii) the triangles formed by 2, Z», Z3 and 24, Zs, Zs are similar. 


2. In theorem 10.2, prove that 


SO) = nlan. 
3. Prove that, if 
Oi Gy itp Se as Obs 


no root of the equation 
AnZ" + An—2"+...+ay = 0 


lies in the closed unit disc |z| < 1. 


4. State the connection between phz and arc tan(y/x), the latter having its 
principal value @ where tan 0 = y/x and —47 < 6 < 4z. 


5. For what values of z are the following functions differentiable? 
z, 1/@*+1), |z/", 
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6. If, for all z in a region, fis differentiable and |f| is constant, prove that fis 
constant. 


7. Suppose that we define z; < z, to mean either 
(i) lz] < |zal 
or (ii) |z,| = |z2| and phz, < phzp. 
Would this establish an order among the complex numbers? 


8. Find conditions that the equation 
az+bz+e =0 


shall give (i) one value of z, (ii) no value, (iii) infinitely many values. 


9. Prove Lagrange’s identity 


2 n n - Tr 
= Dial? D lbl2- 2 larb—a,b,|*. 
1< 


ral rel ree<n 


n 
X a,b, 
rel 

Deduce the Cauchy-Schwarz inequality (2.13) for complex numbers. 


10. (Mean value inequality.) If |f’| < M on the segment [z, 2], then 
\f@)-fy)| < M\|z,—4|. 


10.3. Conformal mapping 


Some parts of complex function theory gain in clarity if geometrical 
language and diagrams are used. There will be nothing unsure in the 
foundations of what we do; everything can be expressed in analytical 
terms. But a geometrical picture can be more vivid and revealing than 
collections of equations. 

The geometrical meaning of f'(z). Suppose that f is regular in a 
region D. Then w = f(z) maps D onto a set of points in the w-plane. 

Let a be a point of D at which f’(a) + 0. Let f(a) = b. Then, as 


=" Bee esyices 
— fia 
z-a@ 
If f'(@ = k(cos«+isin «), where k > 0, then 
|w—b| Left 
lz—al 
and Ph(w—6)—Ph(z—a) > « (modulo 27). 


Suppose that z approaches a along a curve C represented by a 
differentiable function z = z(t) for ty < t < t,, where z(to) = a and 
z'(to) + 0. In the w-plane there is a corresponding curve I’, 


w = f{2()} and w'(tc) = f'{2(to)}2'(to). 
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Hence w’(t) + 0 and T has a tangent at b. If the tangents to C and 
I’ make angles f, y with the respective real axes, then 
y—f = «(mod 27), 
It follows that, if two curves C, and C, meeting at z = a are mapped 
into I’, and I, meeting at w = 5, then the angle between the tangents 
at b to I’, and I’, is equal to the angle between the tangents at a to 
C, and C,, the angles being measured in the same sense. 
A mapping with this conservation of angles is called conformal. 


10.4. The bilinear mapping. The extended plane 

A good initiation into the methods of complex function theory is a 
close study of some simple functions (or mappings or transforma- 
tions). 

As a first example, let us try to form a mental picture of the 
transformation from z to w defined by 

w = (2+i)z+(34+2i). 

Here w is a function of z of the same form as y = 2x+3 in real 
numbers. This relation (Jinear in the elementary sense) is seen as a 
straight line in the (x, y) plane. A corresponding picture relating z 
and w would need four dimensions, two for each complex variable. 
The best that we can do is to envisage a z-plane and a w-plane and 
to hold together in our attention configurations in the two planes 
which are connected by the given relation. To illustrate this procedure 
we discuss relations of the simplest possible types. 

(1) w = z+b. Any figure in the z-plane is transformed into its 
w-counterpart by translation through the vector b. 

(2) w = az. Let a have modulus k and phase «. Then 

w=kz, where z, = z(cosa+isin ), 

The former of these equations represents a change of scale by the 
factor k, and the latter a rotation through the angle « about the 
origin. 

(3) w = az+b, The geometrical operations involved in this com- 
bination of (1) and (2) are translation, change of scale, rotation. 

Note that (if a + 0) the mapping is everywhere conformal. 

(4) w = 1/z. This defines w for all z except z = 0. If 

z = r(cos +i sin 6), 

then w = p(cos $+isin ¢) where p = l/r and ¢ = —8@. 
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We recall that two points A, B are inverse in a circle with centre O 
and radius c if O, A, Bare in line and OA.OB = c*. 

Then w = 1/z corresponds geometrically to (i) inversion in the 
circle having centre at the origin and radius 1, and then (ii) reflection 
in the real axis. These two operations can be performed in either 
order. 

The point at infinity. In example (4) there are advantages in 
adjoining a ‘point at infinity’ to the complex plane. The symbol 
co is defined to have the properties 

a+o = 0+a= 0 
for any (finite) complex number a, and 
b.c = 0.b = «© 


for any b + 0, including b = «. 
We agree further that 


if a+0 then a/0 (oe) 
and if b+oo then b/o =0. 


It is not profitable to try to define «+0 because algebraic 
manipulations involving this operation would lead to inconsistencies. 


ll 


Observe that in complex function theory we are content with one point at 
infinity (or one infinite value). In different branches of mathematics other 
conventions about infinite elements may be appropriate. The reader will see 
from §4.2 that if an infinite element were adjoined to the set of real numbers R* 
it would have to carry a + or — sign. The view is there taken that rules for 
algebraic manipulation would be of more nuisance than value. Such rules would 
have included, for instance, co+00 = «©, but co—co could not be interpreted 
without violation of algebraic laws. ' 

In plane projective geometry every straight line has a point at infinity and 
these points form the /ine at infinity. 

A pictorial illustration of the complex number © is contained in the notes 
at the end of the chapter. 


Denoting the complex plane by Z, we shall speak of Z with the 
point co added to it as the extended (or closed) plane and call it Ze 

Returning to w = 1/z which precipitated this discussion of «, 
we see that in the extended z and w planes the mapping is bijective, 
the point 0 in either plane corresponding to ©o in the other. 

The bilinear mapping. Let a, b, c,d be (complex) constants such 


that ad—bc + 0. Then arth 


~ ¢z+d’ 


or czw—az+dw—b = 0, 
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is the most general algebraic relation which is linear both in zand in w. 
(If ad = be, either w or z is constant.) This mapping is called bilinear 
(or homographic) and is sometimes named after Mébius (1790-1868) 
who first made an extensive study of it. 

Suppose that c + 0, for, if c = 0, we are back at (3). Then 


ee bc—ad 
ce ¢e(cz+d)’ 
ie, w= oe 4= ie Z_ = cz+d, 
c 3 2g 
and so the transformation is composed of simpler ones of the forms 
(3), (4). 
Solving for z in terms of w, we have 
ae =dwt+b 
cw-a 


If we admit a point at infinity in each of the z and w planes, the 
transformation is one-one without exception since w = 00 corre- 
sponds toz = —(d/c) andz = «© tow = c/a. 


10.5. Properties of bilinear mappings 
This section is included, although its results are peripheral to the 
main lines of theory and applications, to illustrate methods of dealing 
with complex variables. When a proof of a result presents no striking 
feature it is sometimes left to the reader, 
For shortness we write w = Tz for 
_ az+b 
~ czt+a’ 


so that T is determined by the matrix 


(a) 


with determinant different from 0. The mapping w = 7z is the same 
if each element of the matrix is multiplied by a constant k (not 0). 
The range of both z and w is the extended plane Z. 


(1) Bilinear transformations form a group. Two transformations 7; 
and 7; are compounded by multiplying their matrices. The associative 


=~ (7,72) Ts = Ti(T2Ts) 
can be verified directly. 
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The unit is i u 


a 


(2) A bilinear mapping is determined by. three conditions. In 
particular, there is a unique w = Tz which maps 2, Z2, Zs; onto 
W1, Wa, Wg respectively. For proof, we could substitute the pairs of 
values in w = Tz and solve for a: b: c: d. It is much easier to intro- 
duce an intermediate variable ¢ which takes the values 0, 1, 00 when 
z is z,, Z, 23 respectively. We can then write at sight 


and the inverse T-! of T is 


z-Z, 
k 1 
Z—Zs 


to give the right values of ¢ for z, and z. The condition ¢ = 1 for 
Zz = Z, fixes k, and we have 
lac (2=21) (Z2—2s) 2s) 
(2-2) (22—41)" 


From the similar connection between ¢ and w we find 


(w—Wi)(W2—Ws) _ (2—21) (22-23) 


(w—Ws) (We Wi) (@—23)(Z2— 21)" 


Corollary. If, in the language of projective geometry, we define 
the cross-ratio (z, Zp 23 24) of the four points to be 


(21 = 22) (Z3- 24) 


(21-2) (Z3— —%)’ 

then cross-ratios are invariant under bilinear transformations. 

(3) The cross-ratio (21222324) is real if and only if the four points 
lie on a circle or straight line. 

Proof. Ph(z, 222324) = oe ae = 
— ye 

By angle properties of circles (or ce this is 0 or 7 according to 
the relative positions of the points. | 


In the rest of this section we shall use the word circle to mean 
either circle in the conventional sense or straight line. A straight 
line in Z is a circle through z = 00, 
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(4) A bilinear transformation maps circles into circles. 

Proof. If we assume (3), the result follows from the corollary to (2). 
Alternatively we can check that each of the transformations (3), (4) 
in §10.4 turns circles into circles. 

(5) The conformal property. The mapping w = Tz is conformal 
except at w = © or z = ©, (We shall not try to interpret con- 
formality at infinite values.) The preservation of angles of inter- 
section under the mapping w = 7z is a useful tool, 

(6) The transformation w = k(z—a)|(z—b), Here circles C in Z 
through a, b, correspond to straight lines through w = 0. Circles 
|w| = p with centre w = 0 correspond to circles D 


fete eh 
z—b| |k] 
(circles of Apollonius for a,b). Any C circle cuts any D circle 


orthogonally. 

We prove that a bilinear transformation maps a circle and two 
points inverse in it into a circle and two inverse points. This is clear 
for the elementary operations of translation, change of scale, rotation 
and reflection which are included in §10.4, (1)-(4). To see that it is 
true for the remaining operation of inversion, suppose that = is a 
circle and a, b are two points inverse in it. All circles [ through a, b 
cut = orthogonally. By the conformal property of preservation of 
angles, the inverses I” of the circles I’ cut the inverse &’ orthogonally. 
The two points common to all the I’ are inverse in 2’. 

(7) Fixed points. A value of z for which z = Tz is called a fixed 
point of the mapping. The quadratic equation gives two fixed points 
(which may coincide). 

If the fixed points are distinct, say p and q, then w = Tz must be 
the same as We? Se=P 


where k is some constant. 
Suppose now that the fixed points coincide. In the special case 
when they are both 0 for the mapping 


cre az+b 
~ ez+a’ 
so that w = z leads to z* = 0, it is clear that d = a,b = 0, c + 0, 
and hence é = Sg) 
woz 


where / is an arbitrary constant. 
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If the fixed points are w = z = p, this becomes 
1 


er 
w—-p z-p 


(8) The general bilinear mapping of the disc |\z| < 1 onto the disc 
|w| < lis 


where |a| < 1 and « is an arbitrary real number. 


Proof. The frontier |z| = 1 will be mapped into the frontier 
Jw] = 1. 

From (6), the points 0, co regarded as inverse in the circle |w| = 1 
will be mapped into points inverse in |z| = 1. These are of the 
form a, 1/a, where |a| < 1. So the mapping is 

z-a 


ig ae 7 


for suitable k. Any point z = e* on |z| = 1 is to correspond to a 
point on |w| = 1. Therefore 
le#—al 
1-Ge*| 
Hence the circles |z| = 1 and |w| = 1 correspond. By theorem 3.33 
a continuous function maps a connected set into a connected set and 
so the disc |z| < 1 is mapped into either |w| < 1 or |w| > 1. Since 
z = a goes into w = 0, we have |w| < 1. | 


|e#—a| 
e# —a| 


1= |e = | Ik|. 


Exercises 10(5) 


1. Prove that the general bilinear mapping of the upper half z-plane (y > 0) 
onto the disc |w| < 1 is 

z-a 
w= ef —— 


z-a@ 
where im a > 0 and « is an arbitrary real number. 
2. Find the transforms under the mapping 


ie z-2 
~ 2241 


of (i) the circles |z| = 1, |z| = 2, (ii) the region 1 < |z| < 2,rez > 0. 


3. Map the unit disc |z| < 1 onto the region |w—1| < 1, taking z = 0 into 
w= 4andz = 1 into w = 0, 
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4. Prove that every bilinear mapping of the upper half plane onto itself is 
expressible as 


with real coefficients and ad—be > 0. 


5. Investigate the convergence of the sequence z,, where z, = TZn-; (n > 1), 
Zo being given and T bilinear. 


6. Prove that w = (z+ 3z)/(3z?+1) transforms circles through z = +1 into 
circles through w = +1. What in Z corresponds to |w| < 1? 


7. In the mapping z*—6z+10 

Sra 
what in Z corresponds to the region |w| > 1? 
8. Prove that, if nm > 1, the transformation 

1 
nee 2 cos (m/n)—z 

is such that 7"(z) = z. Taking n = 3, draw diagrams to show the successive 
transforms 7, T? of the disc |z| < 1. 


9. Transform the quadrantal region x > 0, y > 0, |z| < 1 into the disc |w| < 1 
(via a semicircular region, quarter plane, half plane). 
10. Frame a definition of z, > © as n > 0. 


11. Prove that, if p(z) is a polynomial, |p(z)| > 00 as |z| > 00. 


10.6. Exponential and logarithm 

We assume a knowledge of the exponential, logarithmic and 
trigonometrical functions of a real variable such as can be gleaned 
from Cl, chapter 6. Familiarity with the power series for exp x, 
sin x, cos x (either taken as definitions of the functions or obtained 
from other definitions) is taken for granted. 

The power series 
z gn 
7 Cb sisict Fal “rien 
converges for all complex z. Properties deduced from it such as 

exp (7+W) = exp z exp w 

are valid for complex numbers as well as for real numbers (C1, p. 105). 

The function expz is regular for all z and (theorem 10.2) its 
derivative exp z is never 0. Hence the mapping w = exp z is con- 
formal for all z. To investigate this mapping write 


expz = 1+z+ 


p(cos $+i,sin d) = w = expz = exp x expiy 
= e*(cos y+isin y). 
Therefore p = e” and ¢ = y+2nz, where n is an arbitrary integer. 
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The known period 27 of cosy and sin y shows that exp z has 
period 27i (C1, 115). 

Straight lines x = constant correspond to circles |w| = constant 
and lines y = constant correspond to rays ¢ = constant. (Note the 
preservation of orthogonal intersection.) Any strip of height 27 in 
the z-plane is mapped onto the whole w-plane. 

Consider now the logarithmic function. Can we define it as the 
inverse of the exponential? 

Write w = Logz 
if and only if exp w = z. 


Then r(cos 0+isin 0) = z = exp w = e“(cosv+isinv). Since no 
value of w makes exp w zero, Log z must remain undefined for z = 0. 
e+ 9, Log z = w = utiv = log |z|+iPhz, 
so that Log z has infinitely many values differing by multiples of 277i. 
As in §10.2, we can define a region D by deleting from Z an 
assigned ray from the origin, say the ray phz = @. If we then specify 
the value of Log z at one point of D, this determines a branch of 
Log z continuous at all points of D. Phz will satisfy, for a fixed 
integer k, the inequalities 


a+2kn < Phz < #+2(k+1)7. 


The following definition is now natural. 
The principal value of Log z, written log z, is the value of Log z 
for which Phz takes its principal value phz. In fact, 


log z = log |z| +i phz 


= utiv, say, 


where —m<v<7, 
If z is real and positive, the principal value log z is the real value. 


Properties. (1) If z + 0, then 


d 1 
gq iez=7 


for any value of Log z. 
Proof. Suppose that w = Log z is defined in a region D with 


a+2km < Phz < «+2(k+1)7. 
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Let a be a point of D and b = Loga. Then, at a, log |z| and Phz 
are continuous and w—b > 0 as z—a > 0. 
Log z—Loga w—b 1 1 
= - ie | 
zZ-a expw—expb expb a 


(2) log (1+z) = z-42#+428-... if |z| < 1. 


Proof. The principal value log(1+z) is uniquely defined in 
|z| < 1 because, for all such z, re(1+z) > 0. 
The left and right-hand sides have the respective derivatives 


1(i+z) and 1—z+z?-... 


which are equal for |z| < 1. 

From §10.1, example 1, the difference between log (1 +z) and the 
series z—4z?+ ... is constant. This difference is 0 for z = 0 and 
hence for all z in |z| < 1. | 


(3) Log z,+ Log z, = Log 2123. 
log z,+log z, = log z,z,+2kmi, 
where k may be 0, 1 or —1. 


Complex powers. 


Definition. The power z§ (where z + 0) means exp (€ Log 2). 

In general z‘ has infinitely many values. If ¢ is an integer, z¢ is 
single valued. In particular, z+ = 1/z. 
Definition. The principal value of z* is exp (€ log z). 

By convention e* is always interpreted as the principal value, that 
is to say, exp ¢. 

Properties. (1) zz» = z+ provided that the same value of 
Log z is taken in each of the powers. 


(2) g zb = ¢z'-1, provided that the same value of Log z is taken 


in each of the powers. In particular, if the powers have their principal 
values, the equation holds for —7 < phz < 7. 


Exercises 10(c) 
1. For what interpretations of the many-valued expressions are the following 


true? 
1/zé = 2-*, 2hx 2k = (z,za)F,  (25i)be = zhibe, 


2. Find all the values of i*. 


10.6] EXPONENTIAL AND LOGARITHM 355 
3. Describe the mappings 


w= A (-+4), w = cosh z, 
2 Zz 


4. Find a regular function u+- iv, given that 
v = e(x cos x+y sin x). 


5. Prove that w = tan z maps a strip of the z-plane onto the w-plane with the 
points +i deleted. 


6. Examine for convergence and sum the series 


3 cosnO 2 cos nO cos" 0 
=jp- =1]~a —— 
XC 1) ail XC 1y m4 . 


7. Prove that, if all zeros of the polynomial p(z) have positive real parts, so have 
all zeros of p’(z). 

Prove that, if all zeros of p(z) lie in a convex polygon P, the zeros of p’(z) 
lie in P. 


8. Discuss convergence and uniformity of convergence of 


2 


F L (principal values). 
T 


9. Prove that the function of two complex variables z, w defined (with principal 
values) by 


© 
SG, w) = Yzrnv 
n=1 
is continuous in each of the three sets of (z, w) 
(i) |z| <1, w arbitrary, 
di) |z| <1, rew <0, 
ii) |z| = 1,2 +1, wreal and < 0. 


10. Dirichlet’s problem. The problem is to find a function harmonic ($10.1) in 
a given region taking assigned values at points of the frontier. The general 
problem is difficult and outside the scope of this book. The reader has the means 
of solving it in a disc with continuous values on the circumference. 

Use theorems 9.73, 9.74, 10.2 to find U(r, #) = u(r cos @, r sin @) where u(x, y) 
is harmonic for x*+ 3? < 1 and, asr—>1—, U(r, 0) +f(O) where fis continuous 
for -7 <0 <7, 

Find U(r, 0) when f(@) = 7 cos 40. 


NOTES ON CHAPTER 10 


For alternative contemporary accounts of complex function theory see the books 
of Ahlfors and Cartan. They start at the beginning and carry the subject further 
than we do in chapters 10-14. 


§10.1-10.2. The Cauchy-Riemann equations commemorate the two men who first 
showed the power of complex function theory. Cauchy’s exposition was purely 
analytical. Riemann, three decades later, gave full play to geometrical insight. 
Complex functions and functions from R* to R*. There is a natural one-to-one 
correspondence between the points of R* and those of Z. This induces a bijective 
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correspondence ¥ between the functions from R* to R* and the complex 
functions (i.e. functions from Z to Z). Also, the usual metrics in R* and Z make 
these spaces indistinguishable as metric spaces. Hence, in ¥, continuous functions 
correspond to one another. 

As vector spaces, R® and Z differ; R* is two dimensional while Z is one dimen- 
sional. It is therefore not surprising that F does not give a one-one corres- 
pondence between linear functions. In fact, if the complex function A+ i is 
linear, then the function (A, “)7 from R* to R? is linear; but, if (A, ~)” is linear, 
A+ ip is not necessarily linear. When 


A(x, y) = ax+by, 
(x, y) = ext+dy, 
then A+ ju: Z > Z is linear if and only if 
a=d and b=-c. 


It follows that .F does not give a one-one correspondence between differentiable 
functions. If the complex function u+iv is differentiable, then (u,v)? ; R®? + R® 
is differentiable; but if (u, v)7 : R®? > R® is differentiable, then u+iv is differen- 
tiable if and only if 
U, =v, and w= —v, 
It is this restriction that makes all the difference between the theory of different- 
iable functions from R? to R? and the theory of complex differentiable functions. 
The operators 2/éz, 8/@Z, We express some arguments, e.g. §10.1, example 2, 
in terms of conjugates z, Z, but some writers use them more extensively than we 
do, It is possible to treat formally z, Z as independent variables, though in fact 
they are connected. On this basis, 


Lee 2 _iZ) #3 id) 
Z-3 Us | Ra real peete 


The condition for regularity of f then takes the compact form 


tao 


az 


This usage is particularly helpful in dealing with functions of more than one 
complex variable. 


§10.4. The Riemann sphere. There is a geometric model in which all complex 
numbers, including 0, are depicted on a sphere. Let points z = x+iy be 
represented as usual in a plane Z. Through the origin O(z = 0) draw a line 
perpendicular to Z carrying a third coordinate u. Take the sphere S 


xe+yt+(u-d? = 4 


Let N (the north pole) be the point (0, 0, 1) of the sphere; the tangent plane there 
is parallel to Z. 

Let Q be the point z = x+iy of the plane Z, Let QN cut the sphere in P. 
Then P shall be the point of S representing the number z. The point N (having no 
finite counterpart in Z) represents 00. 

We verify that there is a metric defined on the sphere. We have NP.NQ =1. 
Suppose that Q,, Q, are points of Z representing z,, z,; and that P;, P, are the 
points of S derived by projection from N. 
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Then the triangles NO, Q2, NPP, are similar and therefore 
P,P, _ NP; _ NPs.NQy 
Q:0, NQ, NQ,.NQ, 
P,P; 1 
ee la-al ~ + C4 
The chordal distance P,P, satisfies the conditions for a metric; let us call it 
an nal ©, the corresponding formula is 
1 1 
“NO.” f+ lal 
The reader may verify that, if p(2m, Zn) > 0. as m + 00, n 00, there is a unique 
Zo (possibly 00) such that lim p(Zo, zn) = 0. In fact, with the chordal metric, the 
extended plane Z is a complete metric space. 


NP, 
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COMPLEX INTEGRALS. CAUCHY’S 
THEOREM 


11.1. Complex integrals 

The deeper-lying properties of complex functions were first 
brought to light by integrating the functions along curves in Z. 

We have already to hand in §8.1 and §8.2 definitions and theorems 
for curves and integrals in R”, and it was noted that they are applic- 
able to Z. It will now be helpful to restate some results and to prove 
new ones in notation which is most appropriate to complex functions. 

Given a path y represented by 


z=2t)=x(t)+in0 (@<t<d) 
and a continuous function f = u+iv: G— Z, where G is an open 


set containing the trace of y, we define i! f to be 
v 


[feo 


proving as ing8.2 that the value is independent of the particular 
representation of y. The integral is the same as 


o/ dx dy rela a Sa es 
fe G-e Parsi’ (0G ru Gh) at 


and it could be defined as such. 

The integrals with respect to ¢ are Riemann integrals of piecewise 
continuous functions. In proofs which follow, we can treat the 
integrands as continuous and omit any mention of the finite number 
of discontinuities that dx/dt and dy/dt may have; the proof would be 
completed by adding the results for the intervals of continuity. 

If z(a) = 2(b), so that the initial and end points coincide, we call the 
path a circuit. 

If z(t) + 2(t2) for different t,, 4, in a < t < b (except for a, b if 
the path is a circuit), that is to say there are no double points, the 
path is called simple. (A circuit is not assumed to be simple unless 
this is explicitly stated:) 

We shall prove in theorem 11.11 an inequality which is in constant 
use. 
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Lemma. If f is a complex-valued function defined ona < t < b, then 


[firma < [isolde 


Proof. The simplest method is to approximate to the integrals by 
finite sums and use the known inequality 


n im esd 
Du tide, < Blur +0). 


The following alternative is more stylish. If « is a constant, 
b 'b b 
re [e~ i f(t) ai z " re {= f(i)} dt < i flat. 
a a a 


If « is chosen to be the phase of J(t)dt, the first term in the line 


above is 


[fou 


(If that integral is 0, then « is not defined, but no proof is needed.) | 


Theorem 11.11. If |f| < M and y has length |, then 


ly 


Proof. By the lemma the left-hand side is at most 


Finlgl <a) += 


dt 
from theorem 8.13. | 


< MI. 


From time to time we shall need theorems about complex integrals 
which extend results known for real integrals. The next theorem, on 
term by term integration, is an instance. 


Theorem 11,12. Let each function f,, be continuous in G. Let the 
sequence f,, converge uniformly to f on any compact subset of G. Then f 
is continuous in G and, for any path y in G, 


[ar] ys 


Proof. The continuity of f in G follows from theorem 5.21. If 
Sn = Up tiv, and z = x(t)+iy(d) is a representation of y, then 


oo fe dx dy f°(. & dy 
ee (un Sen Gp) if (on Spt Gp) 
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Theorem 5.22 is then applicable to the integrals on the right-hand 
side (the interval [a, b] being the union of pieces in which dx/dt and 
dy/dt are continuous). | 


11.2, Dependence of the integral on the path 


Suppose that fis continuous in a region D of the z-plane. If we 
take any two points Zo, z in D, it is important to know in what cir- 


cumstances [ J has the same value for all paths in D joining zy to z. 


yd 
This is the same as asking whether ii f round every circuit in D is 
zero, because, if y, and y, have the same initial and end points, 7, —7, 


is a circuit and = | -{ 4 
m-v n Ys 


Theorem 11.2. The value of i TS is the same for all paths y in D joining 
Y 


any two given points z, and z if and only if there is a function F regular 
in D such that F'(z) = f(z) for all z in D. 


Proof. Sufficiency. If y is the path z = z(t) for a < t < b, then 
“ dz 
=| F'{2()}> dt 
[r-[reas 
od 
= ii a F{z(t)} dt 


F{z(b)}— F{z@} 
= F(z)—F(z)). 


Necessity. Fixing zo, we note that { JS(©)dé along any path in D 


defines uniquely a function F(z). 

If |A| is small enough, the straight segment (z, z+/) or A say is in 
D and 
F(z+h)- F(z) = ies 


Divide by h and let h tend to 0. Since f is continuous, we have 
F(z) = f(@). | 


Theorem 11.2 enables us to calculate easy complex integrals by 
the technique of the indefinite integral familiar for real functions. 


A convenient notation is f S = [Fly 
Y 
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Example 1. If n > 1, then, along any path joining Zp to 2,, 
ile z-1dz = (z}—zf)/n. 
% 
Proof. z"|n is regular for all z and has derivative z"—1. | 
Example 2. Let y be the circle with centre a and radius r defined by 
z=atre® (<6 < 2m). 


Then, if n is a positive or negative integer, 
| (z—a)""'dz =0 (n + 0), 
Y 


dz ; 
— =2ni. 
yz—a 


Qn 
Proof. The integral is r” ie en! 1d. | 


Example 2 is important. If n > 1, there is an indefinite integral 
(z—a)"/n regular for all z, as in example 1. If m < 1, then (z—a)"/n is 
regular, not in the whole z-plane, but in the punctured plane 
0 < |z—al, and this suffices to give the result. 

If n = 0, and D is any region containing y (say the annulus 
r—6 < |z| < r+6), then there can be no function regular in D having 
derivative 1/(z—a). If there were such a function, the integral round 
y would be 0, whereas it is 277i. 


Example 3. (Integration by parts.) If, in D, the functions ®, ‘Y are 
regular and ®’, ¥” are continuous, then, for any y in D, 
(OF" + 0'P) = [OY]. 
Proof. Clear, 


11.3. Primitives and local primitives 


The noun primitive is often used in the same sense as indefinite 
integral in the calculus. It will be appropriate in this chapter. 
We always suppose that the function fis continuous in a region D. 


Definition. A function f has a primitive in D if there is a function F, 
regular in D, such that F'(z) = f(z) for all z in D. 


Definition. A function f has a local primitive in D if, given any point 
Zy in D, there is a disc with centre zy in which f has a primitive. 
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It will be observed that the step from the first definition to the 
second is like that in §10.2 from regularity of a function in a region 
to regularity at a point. 

We shall need the following modification of the necessity part of 
theorem 11.2, in which restrictions will be placed on the region and 
on the paths of integration. For the detailed definition of the bound- 
ary of a rectangle, the reader may refer to theorem 8.31, corollary 3. 


Theorem 11.3. Let D be an open disc. Let [ Sf = 0 whenever y is the 


yf 
boundary of a rectangle, with sides parallel to the real and imaginary 


axes, contained in D. Then f has a primitive in D. 


Proof. Let z) be the centre and z any other point of D. The rect- 
angle, with sides parallel to the axes, whose opposite corners are at 
Zo, 2, lies in D, There are two paths from z, to z, say 7, V2, each along 


two sides of the rectangle. Then [ f-| f= Ff = 0, from the 
n vs a 


hypothesis. Define F(z) to be the common value of i bg and [ Ms 
nh v 
If h is real and small enough for the horizontal segment (z, z+/) 
to lie in D, then | 
F(z+h)-F(2) = [ife+ode 


Divide by h and let h + 0. Then, since fis continuous, 


# = flo. 


Similarly ie = if(2). 


If F(z) = U(x, y) + iV (x, y), these equations show that U,, U,, V,, Vy 
are continuous and satisfy the Cauchy-Riemann equations. By 
theorem 7.14, U and V are differentiable. By theorem 10.1, F is 
differentiable and F(z) = f(z). | 


Exercises 11 (a) 
1. Calculate the integrals round the circle z = Ret” (0 < 0 < 2m) of x,y, 
|z|, xy. 


2. Calculate the integrals along the line segment from 1 to 2+/ of x, cos z, e*. 
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3. Evaluate the integrals round the unit circle (anticlockwise) of 
Z, |z—1|, 2+ (principal value), 
z+ (the branch continuous for 0 < 6 < 27 and equal to 1 for 8 = 0). 
4. Which of the following functions possess primitives in the disc B(1; 1)? 
(@) logz, (ii) sin(1—z), (iii) _z! (principal value). 


Give illustrations of functions which have local primitives in the punctured 
disc 0 < |z—1| < 1 but not primitives therein. 


5. Let Z, denote the plane Z from which the segment —1 < x < 1,y = Ois 
deleted. Examine whether , : 
zi—1’ J08 (1-2) 


6. Find primitives of the following functions, specifying the regions in which 
you claim the property: 


have primitives in Z,. 


tan z. 


1 
exp (z—1), Pow 


7. Let f be regular in a region D and y a circuit in D, Prove that if ’ is a pure 
Y 
imaginary. (It may be assumed that f’ is continuous.) 


8. Let y be the semicircular path z = Re, where 0 < 0 < 7. Prove that, as 


i oe d: 1 
z 
1 22—10 4 (3) i 
iz 
Make an O estimate for = dz, 
Y 


9. (This is a useful fact e.g. for §14.1, example 2.) Let f be continuous in a disc 
punctured at z = a. Suppose that, as 6> 0, de" f(a+ de) + k uniformly for 
a<0<f.Ify isthe arcz = at+de%, a < 0 < f, prove that 


lim | f= ik(f-@). 
30 Jy 


10. State and prove the analogue of exercise 9, when Re‘? f(Re'®) > k as R + ©, 
uniformly for a < 0 < Band y is the arcz = Re®,a<O<f, 


11. Taking ane 
mf _ f(@)dz (areal) 


to mean the principal value Y 
lim pat iy)idy, 


You J- 


1+ic 
evaluate (P) dz 


i-to 2 
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12. By comparing the integrals 


[i airesiea, [" iremieae, 
pmele 


where £@) = X(—1)"anz", 
n=l 
or otherwise, prove that 
| NW candn 
mn=1m—n 


N 
<7 lanl’, 

n=1 
where the a’s are complex, and ’ means that terms with m = n are omitted in 
the summation, 


13. Prove that, if I’ is the image of the path y by the mapping w = f(z), then 


if g(w)dw = i Sf hf @)dz. 
r 1! 


11.4, Cauchy’s theorem for a rectangle 

We now approach the grand theorem of complex function theory. 
It is normally stated as the vanishing of the integral of a function f, 
regular in an appropriate region, round a circuit. 

We prove this first in a special case, 


Theorem 11.41, Let R be a closed rectangle with sides parallel to the 
axes and @R the circuit of its boundary. If f is regular in a region con- 
taining R, then 
f= 0. 
oR 


The circuit of the boundary of a rectangle with sides parallel to 
the axes is defined in theorem 8.31, corollary 3. 


Proof. Write I(R) = I t 
OR 
into four rectangles of a quarter its size. The integral round @R is 
the sum of the integrals round the similarly oriented circuits of the 
four small rectangles, because the integrals along interior sides cancel 
in pairs. 
We can therefore select one of the smaller rectangles, R, say, for 
which 1(R,) > H(R). 
Now quadrisect R,, finding an R, for which 
1(R,) > H(R). 
Repeating the process of quadrisection we arrive at a rectangle R,, 
for which I(R,) > 4-"I(R). 


. Divide R by lines through its centre 


11.4] CAUCHY’S THEOREM FOR A RECTANGLE 365 


There is, by exercise 3(d) 7, one point z) common to all the closed R, 
Since f is regular at zo, given ¢, there is 6 such that 


S(2) = (20) +f (Zo) (2-20) + (2)(Z— 20), (11.41) 


where |e(z)| < € provided that |z—z,| < 6. 

If n is large enough, R,, lies inside the disc |z—z9| < 4. 

The first two terms on the right of (11.41) form a linear function 
of z and, from §11.2, example 1, their integral round @R, is 0. 

On @R,, the modulus of the last term of (11.41) is less than tes, 
where s,, is the length of @R,,. Hence /(R,,) < 4es;,. But s, = 5/2", 
where s is the length of dR. We deduce 


I(R) < 4"I(R,) < 4"he(s/2")* = 4es*. 


Since ¢ is arbitrary, /(R) and hence f fis 0. | 
oR 


Note. If we assume the continuity of f’ instead of only its existence, 
Cauchy’s theorem is a straightforward consequence of Green’s 
theorem for a rectangle (8.31, corollary 3), 


foude+ody) = G-2) dxdy, 


where the double integral is taken over a rectangle and the line 
integral round its boundary. If f = u+iv is regular, then 


fra = fudx- vdy)+ i (ode +udy). 


The double integrals equivalent to these two line integrals are zero 
by the Cauchy-Riemann equations. 

In his original proof, published in 1825, Cauchy did in fact assume 
the continuity of f’. It was Goursat (1858-1936) who in 1900 first 
dispensed with this hypothesis. We shall see in §11.8 that it is vital 
to have a proof which does not rest on the continuity of f’. 


It will be useful later to know that the requirement in theorem 
11.41 of the regularity of f may be relaxed in specified sets of points. 


Theorem 11.42. Let f be regular in an open rectangle R and continuous 
on its closure R. Then 
f=0. 
oR 
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Proof. We may suppose without loss of generality that the origin 
is the centre of R. Let z = z(t) for 0 < t < 1 bea representation of 
the circuit 2R. Let 0 < a < 1. Then the point z = az(t) traces out 
the boundary @S of a rectangle S similar to R with linear dimensions 
reduced by the factor «. 

By theorem 11.41, 

f=0. 
as 


Now 


Pfft = f,feol arf pactoaz'(oat 


= [fet -saztolle(dr+—a) fstazto}2'Oat 


= p(x) +q(«), say. 


Since f is uniformly continuous in the compact set R, given e, we 
can find a) such that 


|f{z}—flaz(n}| <¢e if a> a, 
Theorem 11.11 then gives |p(«)| < el, where / is the length of @R. 
arid la(a)| < (1-2) Mi, 


where M = sup |f(z)| for z in R. 
Hence, as a + 1 (from below), 


I f-| f70. 

ar Jas 
Therefore [ f=05| 

. aR 


We prove a corollary, which is a weak result compared with 
theorem 11.42 but nevertheless provides a useful extension of 
theorem 11.41. 


Corollary. If, in theorem 11.41, at a finite number of points of R, the 
Junction f is assumed continuous instead of regular, then 


if =" 0; 
oR 
Proof. Suppose that there is one exceptional point, say ¢ inside R. 


Through ¢ draw parallels to the sides of R dividing R into four 
rectangles. By theorem 11.42 the integral round the boundary of each 
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of the four is 0. Adding we have [ f = 0. The corollary follows 
oR 


from a finite number of repetitions of the argument. | 


11.5. Cauchy’s theorem for circuits in a disc 


Theorem 11.5. Let f be regular in an open disc D, except possibly at a 
finite number of points at which it is continuous. Then, if y is any 


circuit in D, 
[reo 
Y 


Proof. Theorem 11.42 (corollary) shows that, for any closed 
rectangle R in D, 


erst, 
oR 


whether R contains exceptional points or not. 
By theorem 11.3, fhas a primitive in D. 
By theorem 11.2, if y is any circuit in D, 


[reo 


The reader will realise that the circular shape of the region is 
inessential. It is possible to extend theorem 11.5, for instance, to a 
convex region (which contains the linear segment joining any two 
of its points). But such an extension has no air of finality. 

A typical example of an integral round a circuit which is not zero 


is (from §11.2, example 2) 
| dz 2 
— = 2zni, 
oF 


where is a circle described counterclockwise round the origin. The 
integrand is not regular at z = 0 and is, in fact, unbounded as z > 0. 

A survey of §11.1-11.5 may well lead the reader to conjecture 
correctly that, if fis regular in a region D, then J, f= 0 provided 
that the circuit y can be ‘continuously shrunk to a point’ in D. 

A necessary preamble to such a theorem is a short account of the 
topological notion of homotopy or the continuous deformation of 
curves. 
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11.6. Homotopy. The general Cauchy theorem 

Suppose that y, and y, are two curves in a region D with the same 
initial point and the same end point. We choose a representation of 
each curve as a mapping y(t), y,() of the interval 0 < ¢ < 1 into D. 
(It will be plain that the particular representations chosen do not 
matter in what follows.) We have then 


yo(0) = ¥,(0) and (1) = 74(1). 


We define y, and 7, to be homotopic in D with fixed end-points if there 
is a continuous mapping z = d(t,u) of the square 0 <1? <1, 
0 <u < 1 into D such that o(t, u) satisfies 


(1,0) = y(t), O41) =n) O<t< 1), 
and 6(0, u) = (0) = y,(0) for all 4) 
A(1, uw) = yo(1) = v1(1) for all u.J 


Thus, as u increases from 0 to 1, Yo is continuously deformed into 
Yu 

For integration we require y, and y, to be paths, but the mappings 
z = O(t, u) for 0 < u < 1 can be general curves. 

Suppose now that, instead of having fixed end points, each of 79 
and 7, is a closed curve. If there is a continuous mapping z = 4(t, u) 
satisfying for 0 < u < 1, instead of (11.61), 


6(0, u) = d(1, u) (11.62) 


(11.61) 


we call the paths y, and y,, homotopic as circuits. 
If, in particular, 6(t, 0) is constant for 0 < t < 1, so that yy) is a 
single point, we say that y, is homotopic to a point in D. 


Theorem 11.61. Let f be regular in a region D, except at a finite 
number of points at which it is continuous. Let y,y be paths in D 
which are homotopic, 

either (i) with fixed end points 

or (ii) as circuits. 


Then fe-fe 


Proof. Let 6 be a mapping of the square R:0 <¢ < 1,0 <u <1, 
into D as prescribed in the definition of homotopy. 
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We can take dissect ons of the ¢, uv intervals 


Orarity <uti<e. <p Sia <a = ly 
0 = ug < ty <1. < Uy < Wy <...< U, = 1, 


so fine that every rectangle 


Ri (ti St < bey ty SU < Uyys) 


is mapped by z = (ft, u) into an open disc B;; contained in D. 

If 0 <j <n, we replace the curve z = d(t, u;) by the polygonal 
path with vertices at z;; = O(t;, u;) for i = 0, 1, ..., m. Call this poly- 
gonal path y; (0 < j < n). The paths yo and y, = y are given by 
z = Ot, uo) and z = A(t, u,). 

Write y;,; for the are of y; joining z,; to z;,1,; and ,; for the linear 
segment joining z;; to Z,, 41. 

Then the segments 

Yin Nita ~Vtj+ — Nig 


form a circuit lying in the disc B,,;. 
Integrating the function f round this circuit, we have from theorem 


11.5 
fr-ff. -f reo. 
YY Yosrr Mrs ” 


Summing this for 0 < i < m—1, we obtain 


1 a Mi a 


Now sum for 0 <j <n—1. Under hypothesis (i) %,; and %p,j 
both reduce to points. Under (ii) the paths 7; and 7,,,; are the same. 


In either case we have 
Jylyo 


Simply connected regions. Intuitively a simply connected region is 
one without holes in it. This idea can be formalized in terms of 
homotopy. 


Definition. A region D is simply connected if every closed curve in D 
is homotopic to a point in D. 

An alternative definition is that any two curves in D with the same 
fixed initial and end points are homotopic. We assume the equiva- 
lence of the two definitions. 


370 COMPLEX INTEGRALS, CAUCHY’S THEOREM [11.6 


Mlustrations. The disc |z| <1 is simply connected: the annulus 1 < |z| < 2 
is not—the circuit z = re‘°(0 < 0 < 27), where 1 < r < 2, cannot be shrunk 
to a point. Nor is the punctured disc 0 < |z| < 1 simply connected. 

If ¥ in theorem 11.61 is a point, we have the most useful of all 
versions of the theorem of Cauchy. It is the one to which we shall 
attach his name. 


Cauchy’s theorem 11.62. Let f be regular in a region D, except at a 
finite number of points at which it is continuous. Then, for any circuit y 
homotopic to a point in D, 
I f=0. 
7 


If D is simply connected, the integral is 0 for any circuit in D, 


11.7. The index of a circuit for a point 


Let y be a circuit and a a point not on y. We seek an analytical 
definition of the intuitive idea of the number of times that y winds 
round a. The reader is reminded that a circuit may have double 
points: with a complicated circuit care is needed in counting the 
turns, 

Definition. The index of y for a is defined by the equation 
peel ee 
MN @ = oF; yz-a" 
Theorem 11.7. The index is an integer. 

Proof. The following proof has the advantage of not resting on 
the geometrical notion of angle. 

Let y be z = 2(t) for « < t < f#. Then 2(f) = z(a). Consider the 
function vot ih 2'(u) 

a2(u)— 


It is continuous for « < t < f. At every point of continuity of z’(#), 
the function A(t) has the derivative 


du. 
a 


NE A()) 
A) = Peer 
Hence the derivative of e~"{z(t)—a} is zero except possibly for a 
finite number of values of t. Therefore e~{z(t) — a}, being continuous, 
is constant. Equating its values for « and /, we have e” = 1 and 
so A(f) is an integral multiple of 27i. | 
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Properties of the index n(y, a). 

(1) For fixed a, n(y, a) is unaltered if the circuit y is continuously 
deformed without passing through a. 

This is a special case of theorem 11.61. 

(2) For fixed y, n(y, a) is constant for values of a in a disc containing 
no point of y. 

To prove this, let y,, be the path y translated through the vector —h. 
The position of a+A relative to y is the same as that of a relative to 
Yn. Therefore n(y,a+h) = nly, a). 

If |h| is small enough, by (1) the right-hand side is equal to n(y, a). 

(3) Suppose that D is simply connected, a is not in D and y is a 
circuit in D, Then n(y, a) = 0. 

Theorem 11.62 shows that the integral defining n(y, a) is 0. 

(4) If y is the circle z = e (0 < 0 < 2n), then 

n(y,a)=1 for |al <1, 
n(y,a)=0 for |a| > 1. 
If |a| < 1, we can by (2) take a = 0, We showed in §11.2, example 


2 that dz 
i = = 2ni. 
yz 


If |a| > 1, we appeal to (3). | 


From (4) the circular path y defined by z = z)+re“ (0 < t < 2m) 
determines two regions. The first D,, containing all points a for 
which |a—zo| > r, is unbounded. The index n(y, a) = 0 for every 
point of D,. In the other region D,, consisting of points a such that 
|a—zo| < r, we have n(y, a) = 1 and n(—y, a) = —1. We then say 
that y is positively oriented and —y is negatively oriented. 

If y is a simple circuit of a different shape, say a rectangle, a direct 
proof could be constructed that again y determines two regions in 
one of which n(y, a) = 0 and in the other n(y, a) = +1 (according 
to the orientation). In applications of complex function theory a 
circuit is always an easily defined curve, e.g. one made up of straight 
segments and circular arcs. We shall speak of its outside (points a for 
which n(y, a) = 0) and its inside (points a for which n(y, a) = 1 if y 
is positively oriented), 

There is a general theorem that any simple closed curve divides 
the plane into two regions, the outside of the curve and the inside. 
This topological result, Jordan’s curve theorem, is harder to prove. 
(There is a proof in Newman’s Topology of Plane Sets of Points.) 
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Exercises 11(b) 


1. Adapt the proof of theorem 11.41 from a rectangle to a triangle, and hence to 
a simple polygon. 


2. Prove that theorem 11.41 holds if R contains a finite number of points ¢ at 
which f, though not regular, satisfies the condition lim (z—)f(z) = 0. (Suppose 
4 


2 
that there is one point ¢. Divide R into nine rectangles, the central one Ry con- 
taining ¢; make Ry small). 


Observe that, in the istration [ @ = 2ni in §11.5, the integrand 1/z is just 
Y 
too large as z > 0 to satisfy the requirement in the preceding paragraph. 
3. Comment on the following suggested proof of theorem 11.41. 
Taking @R as the circuit of integration, and 0 < A < 1, write 


I(A) = J Sf(Az)dz. 


iy 2X. 
Then 1'Q) = f af (Az)dz = [=] = J de, 
I A 
Therefore IA = =5 andso J(A) = x 


Letting A + 0, we have A = 0. Now put A = 1. 


4. Compute directly the index of the circuit formed by x = +a, y = +a for 
the origin. 


11.8. Cauchy’s integral formula 
The following is a far-reaching consequence of Cauchy’s theorem 
11.62. 


Theorem 11.81, Let f be regular in a region D, Let y be a circuit in D 
which is homotopic to a point. Let a be any point of D not lying on y. 


Th 
oO n(y, a)f(a) = aa Fs dz. 
Proof. In D define 
a2) - 2-9 +0, 
g(a) = f(a). 


Then g is regular except at z = a, and g is continuous at a. Therefore 
(theorem 11.62) 


0 = [ eae -{ Pa (ee ae 


Z2=@ 


In the last term use the definition (§11.7) of the index n(y, a). | 
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Corollary 1. In most applications y is a simple circuit winding once 
round a (e.g. the circle z—a = re” for 0 < @ < 2n). If the circuit is 
positively oriented, the formula is 
Se esa) 
f(a) = 2ni eae 
Corollary 2. Suppose that f is regular in the annulus R < |z| < S. 
Let B, C be circles with centre z = 0 and radii r, s, described counter- 


clockwise, where 
R<r<|aj<s<sS. 


ones. 1, fan 


2niJoz—a 2niJyz—a 


Then f(a) = 


First proof. Define g(z) as in theorem 11.81. The circle B can be 
continuously deformed into C via the paths z = pet (0 < t < 2n), 
where r < p < 5. By theorem 11.62 


dz = 
Teas. 


and the proof is completed as in theorem 11.81. 

Second proof. Draw a common diameter of the circles B, C, not 
passing through a, 

Apply theorem 11.81 in turn to the 
two simple circuits, one indicated by 
continuous arrows and the other by 
dotted arrows. Add. The two integrals 
along each straight segment cancel. | 

Cauchy’s integral formula shows ree 
that, if the value of a regular function 
is known at every point of a simple 
circuit y homotopic to a point, then its 
value is determined at every point 
inside y. 

In succeeding theorems, in which a will be variable, our usual 
notation will be to replace a by z, and to denote the variable of 
integration by ¢. 

We observe that the only property of f required for the integral in 
theorem 11.81 to have a meaning is continuity on y. This remark 
suggests the next theorem. 
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Theorem 11.82. Let $({) be continuous in an open set containing a 
path y in the -plane. If z is not ony, define 


fe) = [ $Oag 


Then f@= i Ca X 


Moreover f'(z) is continuous. 
Observe that, in contrast with theorem 11.81, the path y is not in 
general closed. 


Proof. We prove from the definition that f’(z) is obtained by 
differentiation under the integral sign. 

Suppose that |4(¢)| < M on y, that y has length / and that d is 
small enough for the disc with centre z and radius d to contain no 
point of y. From the definition of /, 


LE+h-SO _ J b(S) ae 
h 7(—z)(¢-z—h)" 


Therefore 
LfE+h)-fE)_ es = hf b(O)de 
h =2 "J, @=2E=2-0)" 
Take |h| < 4d and use theorem 11.11. The modulus of the right- 
hand side is less than || MI 
4a° * 


Let h > 0 and we have the integral formula for f’(z). 
To prove now the continuity of f’ for any z not on y we again 
estimate a bound of the relevant integral. If |h| < 4d, 


S'(z+h)-f'@ = Ries (= zal Ho)ae 


1 if h 
= | leant eal eee O* 
and the modulus of this is less than 


( 2MI1|h| 
d 


aa 


which tends to 0 as h tends to 0. | 
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11.9. Successive derivatives of a regular function 

Combining theorems 11.81 and 11,82 we see that, if fis regular in 
D, then f’ is continuous. Much more than this is true: 

A regular function has derivatives of every order and they are all 
regular functions. 

We must prove this fact (which will be formally stated as theorem 
11.91). The reader may divine correctly that the argument of theorem 
11.82 by which /’ was proved continuous could be refined to prove 


that 
nen 9") = Fi | Goad 


A direct extension, needing induction, to f(z) on these lines is 
laborious. The following is an alternative proof, depending on 
integration by parts. 


Theorem 11.91. Let f be regular in a region D. Then it has a derivative 
of every order and every derivative is regular in D. Also, if y is any 
circuit in D homotopic to a point, and z is in D but not ony, then 
ws) . Lf S046 
my 3) = | ay 


i 


Proof. There are four stages (i)-(iv) in the proof. 
(i) We shall prove f’ continuous in D, Given z, in D, let 7) be the 


path C=z)tret (<t< 2n), 
where B(zo; 2r) < D. Then, if |z—zo| < r, by theorem 11.82, 


: LO) gy 
f@ = ol i it-yi% 


Also by theorem 11.82, f’ is continuous inside yy and so at 2». 
(ii) Next we prove the stronger result that f’ is regular in D. 
Since f’ is continuous we can integrate the last equation by parts 
(§11.2, example 3) and obtain 


£© 
#0) = 5, [ FOae 


£O 
f@ = ils (cy % 


if z is inside yo, and so for z = Zo. 


By theorem 11.82, 
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(iii) From (ii), the derivative of any function regular in D is 
regular in D. Therefore the derivative of f of every order exists and 
is regular in D. 

(iv) Let now y be any circuit in D homotopic to a point, and z 
any point of D not lying on y. Then, by theorem 11.81, for any 
integer r 

Lf £0) 
wh ees 
nty, 2042) = xe; { FO ae, 
Integrating the right-hand side by parts r times, we have completed 
the proof. | 


We emphasize again that in most applications y is a positively 
oriented simple circuit enclosing z, so that n(y, z) = 1. 

Morera (1856-1909) proved in 1886 a theorem converse to 
Cauchy’s, namely that if the integral of a continuous function round 
certain circuits vanishes, then the function is regular. 


Theorem 11.92. (Morera.) Suppose that f is continuous in a region D. 
Let zo be an arbitrary point of D. Suppose that there exists p such that 


1 Sf = 0 round the boundary y of any rectangle, with sides parallel to 
- 
the axes, contained in B(zy; p). Then f is regular in D. 


Proof. By theorem 11.3, fhas a primitive, say F, in B(zo; p) which 
is regular in that disc. By theorem 11.91, the derivative f of F is 
regular in B(zp; p), in particular at zo, which is any point of D. | 


In conclusion, the reader should satisfy himself that he can relate 
each of the implications in the following summary to the theorem in 
which it has been proved. 

Write: R for the statement / is regular in D; L for the statement f 
has a local primitive in D; P for the statement f has a primitive in D; 


7 for the statement i Sf = 0 for every circuit y in D. 
xv 


Then, with no restriction on the region D, 
Ie=P>L=R. 


If D is simply connected, then P + L. 

Proofs without Cauchy’s theorem? Suppose that f is regular in D, 
that is to say it has a derivative f’. Using Cauchy’s integral formula 
we proved as a first step that f’ is continuous and then established 
the existence of derivatives of all orders. Naturally the reader will 
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ask whether so apparently innocent a result as the continuity of f’ 
can be proved more directly. It seems to have nothing to do with 
integration; can it not be proved without recourse to Cauchy’s 
theorem? It can, and indeed the existence of all the derivatives can 
be proved in a few pages by a more searching analysis of the mapping 
by w = f(z) of a region in the z-plane onto a region in the w-plane. 
But this was achieved only in 1960; references are given in the notes 
on Chapter 11. In 1958 a leading topological analyst, G. T. Whyburn, 
could still write that a direct proof of the continuity of f’ ‘remains 
inaccessible at present by these methods’. 


Exercises 11 (c) 
1. Give the values of the integrals 


zs e 
i =a dz, ih fan 


z=atre? (<0 < 2n). 
2. What are the possible values of 
Lise 
jo 1+ 0 


for paths joining 0 to z (not passing through +7)? 


where y is the circuit 


3. What are the possible values of 
Hf ede 
'y 2(1—z%)’ 
4. Prove that, if y is a circuit having index 1 for the origin, 
x" we SU X" EXP 2X 
ni) 2mi Jy tz a 
Deduce that ‘es 


xn\2 1 ‘Qn 
>a (=) als f exp (2x cos 4) d0. 


where y¥ is a simple circuit? 


5. Suppose that fis regular in the disc B(0; 1+). If |z| < 1, show that 
1 1-¢z 
—{z/? ey mh 
a-kine = 2 [ 10-8 a, 
where C is the positively oriented unit circle. Deduce the inequality 


‘Qn 
U-EMEl <3 [" Me%Iao. 
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6. (Poisson's formula.) Let f be regular when |z| < R,. Prove that, if |a| < R < Ry, 
then 

R?—aa 


1 
FO) = 3 | =a 
where C is the circle z= Re? (0< 4 < mere Deduce Poisson’s formula that, 


ifr < R, 
= ip 
Fire”) af Re a cos <a d)+r ae ae, 
7. Let f be regular for |z| < R. Prove that, if0 <r < R, 
Ac OD (il her 
0) =e is u(0) exp (—i8) dd, 


where u(9) = re f(r exp 19). 


8. Taking, in theorem 11.82, y to be the unit circle described positively, find f 
when ¢ is (i) 1/€, (ii) re ¢. 


9. The function fis regular in the upper half plane y > 0, and continuous on the 
real axis y = 0. Also f(z) = 0(|z|) as zo. Prove that, if » > 0, 


Sf (2) dz, 


fe) =1 sim ie 1© gat 


aa 2 
10. Let /be the segment a < x < b,y = 0. Let D,, D, be regions each having /as 
part of its frontier, D, being in the half-plane y > 0 and D, in the half-plane 
y < 0, Let f, be regular in D, and continuous in D, U /; f; regular in D, and con- 
tinuous in D,U/. Let f, = f, at all points of /. Prove that f, and fy define a 
function regular in D, U/U D3. (Use Morera’s theorem 11.92.) 


11. (Schwarz’s Reflection Principle.) Suppose in exercise 10 that Dy is the mirror 
image of D, in the line y = 0. Let f, be regular in D, and continuous in D, U /. 
Moreover let f, be real valued at all points of /. If then fy is defined in D, by 


Sz) = conjugate of f(z), 
prove that f, and f, define a function regular in D, U/U D.. 


NOTES ON CHAPTER 11 


§§11.1-11.3 could be written in the notation of differential forms. There is now 
an extensive theory of these forms which is of service both in analysis and 
mathematical physics. A good introduction is given by Harley Flanders, 
Differential Forms with Applications to the Physical Sciences. 

With two real variables x, y, a differential form of the first order is, 


w = Pdx+Qdy, 
where P, Q are continuous functions of (x,y) in a region D. If y is a path 


x = x(t), y = y(t), for a’< t < b then f w means 
Y 


[ [P&x(t), VO} xO) + Aix), PO} y(COldt. 
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A differential form which has a primitive in D is usually called exact. A form 
which has a local primitive (i.e., is locally exact) is called closed. We have 
avoided this use of the overworked word closed. 


§§11.4-11.6. Cauchy's theorem, Cauchy published his theorem in 1825 in his 
* Mémoire sur les intégrales définies prises entre les limites imaginaires’. There is 
evidence that he knew the result at least ten years earlier. Ensuing discussions by 
writers previous to Goursat (1883) rested on the equality of a line integral 
f(udx+vdy) along two paths from one point to another in virtue of the Cauchy— 
Riemann equations. Such an approach could not be carried through without 
restricting f’ to be continuous. 

Goursat relied on the method of quadrisection, as used in theorem 11.41. A 
region with a curved boundary was thereby decomposed into whole squares 
and part squares with curvilinear boundaries. In 1900 Goursat achieved a 
proof assuming only the existence of f’ and not its continuity. In his approach 
from the interior of the region to the boundary he used the device, employed in 
theorem 11.42, of a family of curves z = z(t) where 0 < «<1 and a1. 
The success of this method depends on the region being starlike in the following 
sense. 

Definition. The region R is starlike if it contains a point z) such that, if z, 
is any other point of R, the segment [z)2;] is wholly in R. 

The ultimate goal of generality in Cauchy’s theorem at which analysts in 
the early years of the 20th century could aim was that f should be regular in a 
region bounded by a rectifiable curve. Such a region need not be starlike and it 
would be difficult to frame rules for dissecting it into starlike sub-regions. So 
Goursat’s procedure was not final. 

Pringsheim (1901) initiated a method of proof which was widely adopted. The 
quadrisection argument establishes the theorem for a triangle and hence for a 
simple polygon (exercise 11(b), 1). The step from a simple polygon to one which 
may intersect itself is not difficult intuitively. Finally a polygon can be con- 
structed to approximate arbitrarily closely to a given rectifiable curve. The 
difficulties in such a programme lie in the framing of instructions for reducing a 
polygon with self-intersections to simple polygons and defining polygons 
approximating to the curved circuit of integration. 

A proof, on principles derived from both Goursat and Pringsheim, was 
published by S. Pollard (Proc. London Math. Soc. 21 (1923) 456-82). Later, 
T. Estermann distilled the proof of the theorem for a general rectifiable boundary 
into a few pages of elegant analysis (Math. Zeitschrift 37 (1933) 556-60 and 
38 (1934) 641.) 

Following rapid advances in the subject of topology from (say) 1920, topo- 
logical rigour demanded recognition besides analytical rigour. To illustrate that 
new requirement, we recall that the index of a circuit y for a point a (§11.7) 
came to be defined as ‘ a 

Z, 


Ani > 
2mi Jyz—a 


whereas previously it had been apprehended from a diagram as ‘the number of 
turns that y takes around a’. 
The essence of Cauchy’s theorem came to be seen as the invariance of the 


integral [ f for displacements of the curve y. The topologists had, ready to hand, 


Y 
the theories of homology and homotopy which dealt with such displacements. 
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§§11.6-11.7. Topology. M. H. A. Newman, Elements of the Topology of Plane 
Sets of Points gives a good account of ideas and methods, with special attention 
to the parts needed in the theory of functions. 


§11.9. For proofs of the existence of higher derivatives of a regular function 
which make no appeal to Cauchy’s theorem, see E. H. Connell, Duke Math. 
Journal 28 (1961), 73-81; A. H. Read, Journal London Math. Soc. 36 (1961), 
345-352; G. T. Whyburn, Fundamenta Math, 50 (1962), 305-318. 


12 
EXPANSIONS. SINGULARITIES. RESIDUES 


12.1. Taylor’s series. Uniqueness of regular functions 

A multitude of properties of regular functions flows from Cauchy’s 
theorem. We prove first that a function regular in a disc can be 
written as a Taylor’s series. The expression of a regular function in a 
simple standard form, such as a power series, points the way to 
further results. 


Theorem 12.11. Let f be regular in the disc B(a; R), that is |z—a| < R. 
Then, for any z in the disc, 


fl) = fla) +(2—a)f (a) +. OP" f(a) +. 


Proof. Without loss of generality we can take a = 0. Given z, 
choose r such that |z| < r < R. Let C be the positively oriented 
circle € = re?(0 < 0 < 27). 

Then, by theorem 11.81, 

ks) 
fa) = 5, f FO a 
In the integral substitute 
1 ilseat 3 me yi 
ee Pee a 


This gives, by use of theorem 11.91, 
S2) = SO) +2f'O) + FO) + Row 
where R, = = Gy" fG) dé. 
2ni J oN Zz 
When ¢ is on C, |z/&| = |z|/r < 1, and sup | f()| = M, say. Then 
by theorem 11.11, [Ral < K(\z|/)"*, 


where K = Mr/(r—|z|). Hence R, > 0 asn—> oo. | 


Notes. (1) The proof amounts to integrating term by term the 
series obtained by inserting the binomial expansion of 1/(¢—z) in the 
integral. This series converges uniformly for ¢ on C, and we could have 
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appealed to theorem 11.12, the complex extension of theorem 5.22. 
Instead we have estimated the remainder R,, from first principles. 

(2) Contrast theorem 12.11 with the real-variable theorem leading 
to Taylor’s series (C1, 101) in which every derivative has to be 
postulated explicitly and its magnitude controlled to make sure that 
the remainder R, tends to 0. With a complex function all this is 
implicit in the sole assumption of regularity. 

(3) If we are given a power series 


ayta(z—a)+...+a,(z—a)" +... 


convergent for |z—a| < R, we proved in theorem 10.2 that the sum 
is regular for |z—a| < R. Theorem 10.2 (in particular note 2 and 
exercise 10(a), 2) shows that, if f(z) is the sum, then 

a, = f™a)|n! 
Definition of a zero. Suppose f regular in B(a; R). If f(a) = 0, then 
a is called a zero of f. If f(a) is the derivative of lowest order which 
is different from 0, then a is called a zero of order n. (If every derivative 


of fis 0 at a, then, by theorem 12.11, f(z) = 0.) 

Observe that, if fhas a zero of order n at a, then 

S(@) = (@-4)"8(2) 
where g is regular at a and g(a) + 0. 

Moreover there is a disc with centre a, say B(a; 6), throughout 
which the continuous function g is different from 0, so that a is the 
only zero of f in B(a; 6). Thus the zeros of finite order of a regular 
function f are isolated. 

We now investigate regular functions defined not necessarily in a 
disc but in an arbitrarily given region. 


Theorem 12.12. If f is regular in a region D and the set of zeros of f 
has a limit point in D, then f(z) = 0 in D. 


Proof. Let a be a limit point in D of the set S of zeros of f. By 
theorem 12.11, f has a Taylor expansion in any dise T with centre a 
which lies in D. 

If any derivative f(a) were different from 0, there would be a 
circle with centre a containing no zeros of f other than a. But this 
contradicts the vanishing of fin S. So f(z) = 0 for all z in the disc T. 

We extend this result throughout D by the following construction 
of overlapping discs. Let b be any point of D; we wish to prove 
(6) = 0. Join a to b by a polygon P in D (theorem 3.32), Let d be 
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the distance between the sets P and D’. Then the disc of radius d 
with centre at any point of P lies in D. Take points ay (= @), ay, a, ... 
a, (= 6) in order on P with each distance |a,—a,;| less than d. Take 
a disc T, of radius d with centre at each point a,. Then a, is in T,4. 
If f = 0 in 7,_,, then, by the first part of the proof, since a, is the 
limit of zeros of f, we have f = 0 in T,. Hence f(b) = 0. | 


The following restatement of theorem 12.12 is to be noted. 
Theorem 12.13. (Uniqueness theorem for regular functions.) A func- 
tion f, regular in D, is uniquely determined if we know its values at 
points of a set S having a limit point in D (a fortiori, if S is a linear 
segment or arc, however short, in D). 

This follows from theorem 12.12 because, if fand g are two regular 
functions having the assigned values in S, then f—g = 0 in D. 


12.2. Inequalities for coefficients. Liouville’s theorem 
The following simple inequalities for the coefficients in a Taylor’s 
series are due to Cauchy. 
Theorem 12.21. If f(z) = > 4,2" for |z| < R, and M(r) = sup | f(z)| 
0 
for \z| =r < R, then hou M() 
Proof. From theorems 12.11 pod 3) and 11.91, 
SEXO ml LO ge 
~ Oni 


Qn, “nl gut % 

where C is the circle z = re (0 < 6 < 27). 
By theorem 11.11, 1 ek 
lan] < In pe 


2nr. | 


Definition. A function regular for all z in Z is called entire. 
Some writers call an entire function an integral function. 
Illustrations. Any polynomial, exp z, sin z, cos z. 


Theorem 12.22. (Liouville (1809-1882).) An entire function, which 
is bounded, is constant. 


Proof. The function has a Taylor expansion, say 


fle) = 3 ay2" 
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valid for all z, Suppose that | f(z)| < M. From Cauchy’s inequalities 
(theorem 12.21) M 
la,| < a 


Since r is arbitrarily large, a, = Oforn > 1. | 


Liouville’s theorem has many applications. As an illustration we 
deduce from it ‘the fundamental theorem of algebra’. 


Theorem 12.23. Let p be a polynomial (not constant). Then there are 
values of z for which p(z) = 0. 

Proof. If the conclusion is false, 1/p is regular for all z. Now 
|p(z)| > 20 as |z| > 00 (exercise 10(5), 11). So we can find a (closed) 
disc B outside which |1/p(z)| is bounded. But |1/p(z)| being con- 
tinuous is bounded on B. So 1/p is a bounded entire function. By 
Liouville’s theorem it is constant. This is a contradiction. | 


Exercises 12(a) 


In each of 1-8, expand the given function in a Taylor’s series La,,z". Find, if you 
can, the general coefficient a,, or, failing that, the first three non-zero coefficients. 
In each example state the radius of convergence of the series. 


1, The principal value of (1 +z)", where & can be complex. 
2. log cosh’z. 

3. (arc sin z)*, defined to be 0 when z = 0. 

4, tan z. 

5. (cos z)*, defined to be +1 when z = 0. 


9. Expand in Taylor’s series © a,(z— 47)", 
cot z, cosec* z. 
10. If Xa,z" has radius of convergence 2, find the radii of convergence of 
Dakz*, Danz™, Sanz", 
Lakt+ak+...+a*)z", 


where k is a fixed positive integer and in the fourth series a, > 0. 
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11. For each set of values (i)-(v) corresponding to z = 1, 4, 4, 4, 4, 4, ..., find 
whether a function exists, regular at z = 0, taking those values: 

Gye 1:0, -4,.0,4;:0;.....5 

Gi) 1, V4, V5 V4, VE, VS 

Gi) 4444434 .. 

(vy) £44 %5 % te. 

G@)> 1; 3,3, ys, 2s, 35, 


2 
12. Prove that the distance from the origin to the nearest zero of f(z) = Dianz” 
0 


is at least r|aol 
M+ |a)|’ 


where r is any number not exceeding the radius of convergence of the series and 
M = M(r) = sup |f(z)| for |z| = r. 


13. In a region D, f and g are regular and fg = 0 at all points. Prove that 
f=0org=0. 


14. Prove that, if f(z) = Za,z" is regular for |z| < R, then the average value 
of | f(z)|* on |z| = r, where r < R, is Z|a,,|*r*". 

Deduce theorem 12.21. 
15. Prove that, if for n = k Cauchy’s inequality (theorem 12.21) is an equality, 


that is Mr) 
lax] = => 


then f(z) is a constant multiple of z*. 


Ee 
16. Let f(z) = Dane" be regular for |z| < 1+4. Prove that the polynomial p,(z) 
of degree k which minimizes the integral 


‘20 
x f | Fle!) —ple!?)|2d0 


k ey 
is p,(z) = S{a,2z". Prove that the minimum value is >) |a,|*. 
0 k+1 


17. Give an alternative proof of Liouville’s theorem 12.22 by integrating 
Ff(2)/{(z—a)(z—5)} round a circle whose radius tends to infinity. 


18. The function f is entire. 
(i) Prove or refute the suggestion that, to prove f constant, boundedness may 
be replaced by the hypothesis 


|f@)| = o(|z|) as z>o. 
(ii) What conclusion follows if we assume 
|f(@)| = O(\z|*) as z>0? 


19, Prove that, if f = u+iv is regular in Z and either (i) u > 0 or (ii) v < 7 for 
all z, then f is constant. Include (i) and (ii) in a general statement. 
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20. Replace the hypothesis (i) or (ii) of 19 by wv > 0. 


21. The function fis regular in Z. There is a disc B(w); 6) such that no value f(z) 
is in B(wo; 4). Prove that fis constant. 


22. The functions f, g are regular and have no zero in a disc B(zo; r). There is a 
sequence Z, > Z) at which f’/f = g’/g. What follows? 


12.3 Laurent’s series 

Suppose that f is regular in an annulus with centre a (instead of 
throughout a disc), Following Laurent (1813-1854) we expand f(z) 
in a series containing both positive and negative powers of z—a. 

A series > c, is said to converge if, and only if, 4c, and > Cy 

= 0 1 

both converge. 
Theorem 12.31. Let f be regular in the annulus R < |z—a| < S. 
Then, for any z in the annulus, 

fle) = 3B a(z—a)", 

eel eae 

On = ai ot - gyri Me 


and Cis the circle § = a+pe(0 < 0 < 2n), p being any number such 
thatR<p</S. 


where 


Proof. As in theorem 12.11, we can without loss of generality take 
a=0. 
Given z such that R < |z| < S, let C,, C, be circles, with centre 
¢ = 0 and radii r, s, where 
Ri<r'< |zl<s <3. 
By theorem 11.81, hg 2, 


po) =2,f $Oac-1f LO a 


ai a$— oe 
where C, and C, are positively siti 4 
As in theorem 12.11, the — round C, yields the series } a,,z”, 
0 
where Pa vAC3) © ae 
an Cs gui 
* To deal with the integral round C,, we expand 1/(€—z) in powers of 
¢/z (since |£| < |z|), and obtain 


Degg ioe fami 
faz zt at tnt ng—z: 
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An argument like that of theorem 12.11 shows that the remainder 
term in the integral round C, tends to 0 as n > oo, and the consequent 
infinite series is )}a_,2z~", with the value of a, already defined. 

1 


Since the integrand in the formula for a,, is regular for R < |¢| < S, 
the restriction r < |z| < s on the radii of the circles C,, C, can be 
removed (by theorem 11.61(ii)) and we can integrate round any 
circle C in the annulus. | 


Corollary, (Cauchy’s inequalities.) If f(z) = X a,(z—a)" for 

R< |z-a|<S 
and |f(z)| < M(r) for |z—a| =r, where R <r < S, then, for every 
integer n, positive or negative, 
M(r) 
re 


|a,| < 
The proof follows that of theorem 12.21. 
Theorem 12.32, (Uniqueness of Laurent expansion.) 
() YP) = B ay(z—a)" and fe) = 3 b,(¢—a)" for 


R < |z-a| < S, 
then a, = by, for all n. 

(ii) If f is regular for R < |z—a| < S, then f = f,+fy, where f, is 
regular for |z—a| < S and fy is regular for R < |z—a|. Moreover if 
Sa > 0 as |z| + 0, the expression of f as f, +z is unique. 

Proof. (i) If we fix p with R < p < S, each of the two series for 
J(©) converges uniformly on the circle —a = pe?(0 < 0 < 2n), by 
theorem 5.41 extended to cover negative powers of ¢—a. 

It is then legitimate to multiply by (¢—a)-*— and integrate term 
by term round the circuit ¢-a = pe’. Hence 

2ria, = 2nib, (K = 0, +1, +2,...). 


(i) A@ = Sa,(z—a)* and f(z) = z a,(z—a)" satisfy the con- 
0 = 
ditions imposed, To prove uniqueness, suppose that also f = g, +2». 
Th 
oe h=f,-& (\z-a| < 9), 
=f, (\z—a| > R) 


is regular for all z and (since h>0 as |z| > 0) is bounded. By 
Liouville’s theorem 12.22, h is constant and (from |z| > co) is 0. | 
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Exercises 12(5) 
1, Write down the Laurent expansions of 


1 1 


z-2 2-1 

appropriate to the respective regions |z| < 1, 1 < |z| <2, 2 < |z|. 
Expand similarly 

z eel mre 

(z—1)(z—2)" z%(z—1)(z—2)’ (z?+ 1) (2? +4) 


2. Expand in positive or negative powers of z 
peel 
1+z+2*° 

3. Prove that, for all finite z except 0, 


wo 
cos {u(z+2z71)} = & cpz™, 
2 pi ee 
where Ce i; cos (2u cos 9) cos 2n0d0. 
0 


4. Establish the expansion 
ed 
exp {4u(z—z-)} = DY Jn(w)z", 
pr) 


where J,(u) = } f cos (nO—u sin 0)d0. 
Prove also that, if n > 0, 
a (- 1 eynt ake 
Inu) = 2 ami tiK ne BD! 
while, if is a negative integer —m, 


Inu) = In(— 4). 


5. Discuss the possibility of expanding in power series 
{@-1)(-2)} 


in a suitable circle or annulus. 


6. The same question for log — 
o 

7. The regular function w= Dayz" 
~e 


is a bijective mapping of the closed ring r; < |z| < rz onto a compact set S of 
the w-plane. Prove that the area (or content) of S is 


EA 
7X n|aq|*3"— 17"). 
mes : 
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12.4, Singularities 

Suppose that f is regular in the punctured disc 0 < |z—al < R. 
We ask whether, with the right choice of the value of f at a, the 
function thus extended is regular in the whole disc |z—a| < R. 


Theorem 12.4. A sufficient (and necessary) condition that f, regular 
for 0 < |z—a| < R, can be extended to a function regular in 
|z—a| < Ris that 

(z-a)f(z)>0 as z>a. 


Proof. There is a Laurent expansion 
S(®) = Da,(z-a)" for 0 < |z—-al< RK. 


Let M(r) = sup |f(z)| for |z—al| =r. 
Then, from the hypothesis, 
rM(r)>0 as r+0. 
By theorem 12.21 (corollary), 
la_,| <7"M(r) if n> 1. 


Therefore a,=0 if n21. 


If f(a) is defined to be ap, then f(z) = 5 a,(z—a)" for |z—a| < R 
0 
and this is regular. | 


Definition. f is singular (or, has a singularity) at a if it is not regular 
ata. 


Definition. If f is singular at a and regular in a punctured disc centre 
a, the singularity at a is isolated. 

If the condition of theorem 12.4 is fulfilled, we can assign a value 
to f(a) so that f is regular at a. Such a point a may be called a 
removable singularity of f. We generally suppose that removable 
singularities have been removed. 

Mlustration. We shall say, without more ado, that the function 
1—cos 2z 
z 


is regular for all z, on the understanding that the value 2 is assigned to it for 
z=0. 
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The condition (z—a)f(z) +0 certainly holds if f is known to be 
continuous at a. In that case, there is, in fact, no singularity at a 
and it was only lack of knowledge that previously stopped us from 
asserting that fis regular at a. The clause in theorem 11.61 permitting 
a finite number of points of continuity rather than regularity was 
therefore only temporarily useful and now loses its significance. 

If ais an isolated singularity of f, there is a Laurent expansion in a 
punctured disc, say e 
S@ = x a,(z—a)”. 


Definition. If the Laurent expansion of f has only a finite number of 


m 
negative powers, say ¥) a_,(z—a)-", where a_,, + 0, then a is called 
1 


a pole of order m of f and 3 a_,(z—a)~ is its singular (or principal) 
1 


part. 
A pole of order one is called a simple pole; one of order two a 
double pole. 


Definition. If there are infinitely many negative powers of (z—a) in 
the Laurent expansion, then a is called an essential singularity of /. 


z a,(z—a)~ is the singular part of f at a. 


Mlustration. exp (1/z) has an essential singularity at z = 0. 


Before §13.3 we shall be concerned only with isolated singularities. 
We shall there encounter functions having singularities which are 
limit points of singularities. 


Definition. A function which is regular in a region except at poles is 
called meromorphic. 


12.5, Residues 
We suppose that / has an isolated singularity at a and the usual 
Laurent expansion. 


Definition. The coefficient a_, of (z—a)~ is called the residue of f 
at the singularity a and is written res(f, a). 
From the definition of a_, (theorem 12.31) 


27ia_, = [ps 
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where C is a positively oriented circle containing the singularity a 
and no other. 

This formula for a complex integral round a suitable circuit in 
terms of the residue of the integrand at a singularity constitutes a 
powerful method of calculating definite integrals. The next theorem 
caters for any number of singularities. 


Theorem 12.5. (Residues.) Let f be regular in a region D except for 
isolated singularities c (which form a countable set C). Let y be a 
circuit in D which is homotopic to a point in D and is free of points 
of C. Then the index of y is zero for all c except a finite number and 


[r- Dnt Sinly, c) 168 (7.0). 
Ps ceC 


Proof. Let K be a compact set in D. Then the set Kn C is finite, 
for if not K would contain a limit point of C which would be a non- 
isolated singularity. 

We proceed to define the particular K which is used in the proof. 
The definition of homotopy requires a continuous function 


6: (0, 1] x [0,1] + D 


such that 3(0,u) = o(1,u) for O<u <1, d(t,0) for O<t <1 
represents y and d(t, 1) (0 < t < 1) is a point curve yo (i.e. is con- 
stant). Since [0, 1] x [0, 1] is compact, so is 


K = 8({0, 1] x0, 1). 
From §11.7 (1), if b is any point of Z—K, 
n(y, b) = n(yo, b) = 0. 


Let C, be the set of singularities of fin K and C, those in D—K. 
We have proved that C, is finite and that n(y, c) = 0 at every point 
of the countable set C,. 

We shall prove that D, = D—C, is a region. 

Let z € D,. Then z cannot be a limit point of C, for, if it were, z 
would be a non-isolated singularity of f. Therefore there is a 
B(z;6) < D—C, and so D, is open. To prove now that D, is 
connected, let z,, z, be two points of it. There is a polygon in D 
joining z,, z. Its trace is compact and so it can go through only a 
finite number of points of C,. Each such point, being isolated, can be 
avoided by a small detour. 


392 EXPANSIONS, SINGULARITIES, RESIDUES [12.5 


In D,, fis regular except at the points of Cj, say ¢,, Ca, ...5 Cp. Let 
S(F, cy) be the singular part of fat c;,(k = 1,...,p) and, for z in D,, put 


ae) = f@)- ES, «- 


Then g is regular in D,—C, and at each c;, it has a removable 
singularity. By theorem 11.62, 


fiero. 
 § 


We shall prove that, at a point c(= c,) of C,, 
i Sf, c) = 2zin(y, c) res (f, c). 
ci 


Since c is not on y, there is a disc with centre c containing no 
point of y. The power series in 1/(z—c) 


Sf, 0) = a_(z—o)™ 
converges uniformly on y. Hence 
i) Sid) = Sa, J (2-0)-ndz, 
Y 1 Y 
Since (z—c)-” has, for n > 2, a primitive (z—c)-"+1/(—n+1), it 
follows that [ (z—c)-"dz = 0 forn > 2. 
¥ 


Finally, af (z—c)“dz = 2ni n(y, c) res (f, c), from the definitions 
z 


of index and residue. 
From the definition of g and the vanishing of its integral on y, 


[p= ani & mer, os) 08 Fo. 
Y k=1 


Since n(y, c) = 0 if c € C,, the right-hand side is 
2ni Y n(y, c) res(f,c). | 
ceC 


12.6, Counting zeros and poles 
Suppose that f has a. zero of order /at a. Then, from the definition 
of a zero (§12.1), there is a disc B(a; 6) in which 


f@ = @-ag2), 
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where g(z) is regular and not zero. In this disc 

S'® = Wz—a)g(z) + (z—a)'g'(z). 
Hence, for 0 < |z—a| < 4, 


£@__! @ 
J@)  z-a gz)’ 

where g’/g is regular in B(a; 6). 

Therefore f has a simple pole at z = a with residue /. 

Similarly, if f has a pole of order m at a, then f’/f has a simple 
pole there with residue —m 

The following theorem which enumerates the excess of the number 
of zeros over the number of poles of a function meromorphic in a 
region is particularly useful when the function is regular and we are 
counting its zeros. 


Theorem 12.61. If {(= 0) is meromorphic in the region D and y is a 
Positively oriented simple circuit in D, passing through no zero or pole 
of f, homotopic to a es in D, then 


ari Fo 
where N is the number of zeros and P the number of poles of f enclosed 
by y (a zero or pole of order | being counted | times). 


Proof. The index n(y, z) is 1 for points z enclosed by y and 0 for 
other points. The theorem follows from theorem 12.5 and the first 
two paragraphs of §12.6. | 


Corollary. If g is regular in D, then 
fy = 
ari | SO GO de = Zeta) —Eatb,) 
summed over the zeros a; and the poles b; of f enclosed by y. 
Adapt the argument of the theorem. | 
In applying theorem 12.61 we observe that 


| aol bey ‘Oy i 1 dw 
Qn}, f(2) 2niJr w 
where T' corresponds to y by the mapping w = f(z) from the z-plane 


to the w-plane (exercise 11 (a), 13). The w-integral is the index n(I’, 0) 
of I for the origin. 
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The reader should work out for himself the application of this 
principle to numerical examples. The following exercise is typical. 
Exercise 12 (c), 0. Find how many roots of the equation 


—3z8+7z?-92+6 =0 
lie in each quadrant. 
The solution is at the end of the book. 


Here is another result which is useful in root-counting. 


Theorem 12.62, (Rouché (1832-1910).) Suppose that f and g are 
regular in D. Let y be a simple circuit, homotopic to a point in D. If, 
for every z on y, |\g(z)| < | f(z)|, then y encloses the same numter of 
zeros of f as of f+g. 

Proof. Since |g| < |f|, neither f nor f+g has a zero on y. The 
point w = 1488) 2, for z on y, lies in the disc B(1; 1). By §11.7 (3), 


if Tis the w-image of y, then 


1 ¢ dw 
a ae ls 0) = 0. 
ldw_f'tg' _f’ 
— wdz~ feg i" 


Integrate this round y, and divide by 27i. The theorem then 
follows from theorem 12.61. | 


A quick deduction from Rouché’s theorem is: A polynomial of 
degree n has n zeros. 
Proof. Let f(z) = 2", g(2) = a2" 1+...+ap. 
If y is a circle, centre 0 and radius r, where 
> |a,|r74+...+ an], 
the polynomial f+g of degree n has the same number of zeros inside 
y as 2” has. But z” has n zeros at z = 0. | 
A numerical illustration of Rouché’s theorem follows. 
Example. Show that the roots of the equation 
z>—1222+14 =0 


lie between the circles |z| = 1 and |z| = 3. How many lie inside the 
circle |z| = 2? 
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Solution. On |z| = 3, take f = 2°, g = —1227+14. 
pee lel < 75+14 < 3125/32 = | fl. 


Sof+g = 0 has the same number of roots inside |z| = 3 as f = 0, 


namely 5. 
On |z| = 1, take f = 14, g = 25-1223. 
On |z| = 2, take f = —122%, g = 25+14. 
Exercises 12(c) 
1. Evaluate the integrals round the unit circle, described positively, of 
1 1 
2 sin — 2. kteineerie 
iz sin» iar a PE-D" 


2. Prove that, for all sufficiently large R, the integral of (z—a)-"(z—6)-" round 
the circle |z| = R is 0. 


3. Prove that z°+3z°+7z+5 has two zeros in the first quadrant. How many 
zeros are in |z| < 4? 


4. Prove that, if a and 6 are positive, the equation 
zAtazt+b =0 


has one and only one root in the first quadrant, and that its phase is greater 
than 47, 


5. Prove that z°+3z*—5z*+ 10z*—1 has three zeros with rez > 0. 
Prove that it has two zeros in the ring $ < |z| < 1. 


6. Prove that the equation e*-! = z" has n—1 roots inside the unit circle if n > 2. 


7. Prove that the function sinh 7z takes every value w, such that re wo > 0 
exactly once in the region rez > 0, —4 < imz < 4. 


8. Find the number of zeros of z(z*"+1)+1 having —7/n < phz < 7/n. 
9. Prove that, if |a| < 1, then 


has m+n zeros in |z| < 1. 
10. Prove that the function sin z—z has just two simple zeros in each of the 
sual (2n—4)m < rez < (2n+4)r, 


where n is an integer other than 0; and that, apart from the triple zero at z = 0, 
these are its only zeros. 
11. Prove that, however small ¢ is, all the zeros of the function 
sD | 1 
I+ = ots tat Chui a 


lie in the disc B(O; 4) if n is large enough. 
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12.7. The value z = 0 

In §§10.4, 10.5, we paraded the advantage of adjoining a point at 
infinity, z = 0, to the complex plane Z. The treatment of the 
bilinear transformation was neater in the extended plane Z. In 
chapters 11 and 12 (so far) the value oo has been left on the shelf, for 
a good reason. Everything has been based on integration, and the 
inclusion of z = oo in a path of integration makes its length infinite 
and entails an additional limiting operation. 

We assume that fis defined for all (finite) z if |z| is sufficiently large. 


Definitions. f(z) is said to have an isolated singularity for z = © if 
S(1/z) has an isolated singularity for z = 0. Moreover the former is a 
pole or an essential singularity according as the latter is. 

F(z) is said to be regular at 00 if f(z) is regular for |\z| > r and 
lim f(1/z) is finite. (By theorem 12.4, the latter condition holds if 


lim 2f(1/2) = 0.) 


Mlustration. At z= 0, the function z* has a double pole and sin (1/z) a 
simple zero; exp z has an essential singularity. 


We can now state Liouville’s theorem 12.22 in a more cogent 
form. 
A function regular in Z is a constant. 


Proof. From the definition of regularity at oo, there are constants 
A, 7 such that |f(z)| < A if 0 < |1/z| < 7. Now, regularity of f for 
all finite z shows that |/(z)| < B if |z| < 1/y. Theorem 12.22 gives 
the result. | 


Another useful result, extending Liouville’s, follows. 


Theorem 12.71. If f is meromorphic in Z, then f is a rational function 
plq, where p and q are polynomials, 


Proof. The number of poles of fis finite, since an infinite set would 
have a limit point either at z = a (finite) or z = 00, f would have no 
Laurent expansion about this limit point and it would not be a 
regular point or a pole of f. 

Let a, de, ..., a, be the finite values of z which are poles of f, and 


let 
S4(Z), S2(2Z), «+3 Sn(Z) 
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be the respective singular parts of fat these poles. If z = © is a pole, 
the singular part there is of the form 


S.(z) = byzt...+B_2™. 
Then fl2)-¥ S2)- S22) 


has no singularities for any z in Z. Therefore by the form of Liou- 
ville’s theorem just stated, it is a constant A. So 


fle) = A+B S{2)+ So) 


which is a rational function. | 


In further developments the best setting will be sometimes Z and 
sometimes Z. In a discussion of singularities of a function, the 
behaviour at co should be specified. 

We shall not use the residue of a function at oo. The definition 
(which needs care) is in a note at the end of the chapter. 


12.8. Behaviour near singularities 

Suppose that a is an isolated singularity of /. 

If a is a pole of order n, the definition shows that | f(z)| tends to 
infinity as z tends to a, and its order of magnitude is given by 
f(z) ~ a_,(z—a)~™. In contrast, the behaviour of f(z) as z approaches 
an isolated essential singularity is erratic. 


Theorem 12.8. (Casorati-Weierstrass.) Let a be an isolated essential 
singularity of f. Given any complex number b and arbitrarily small 
positive numbers r, €, there exists z in the punctured disc 


0 < |z-a\ <r 
such that |f@)-8| <«. 


(At points arbitrarily near to a the function takes values arbitrarily 
near to any given number.) 


Proof. If there isazin0 < |z—a| < r where f(z) = 6, the theorem 
is proved. If not, write 1 


8= 75 


Then g is regular in 0 < |z—a| <r. 
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If g is bounded, then a is a removable singularity of g and 
Jf = b+(1/g) has a removable singularity or a pole at a. In fact f has 
an essential singularity at a. Therefore g is unbounded and there is a 
z for which |g(z)| > 1/e. | 


Illustration. exp (1/z) assumes all values except 0 arbitrarily near to 
= 0. 


Proof. Write exp (1/z) = b = pe™ say (p > 0). 


Then z1 = log p+i(a+2nn). 


To make |z| < r, we have only to take the integer n large enough 
to make (log p)?+(«+2nm)2 > r. | 

When a = © the results of this section are of daily relevance. If 
FG) is polynomial Ay +QyZ+...+_2", 
where a, + 0, then oo is a pole of order n. 

If f(z) is an infinite series in powers of z (or z—Z 9) convergent for 
all z, then f is an entire function and ©o is an isolated essential 
singularity. 

Entire functions, a class which includes some of the most useful 
functions of analysis like expz and sinz, show the Casorati- 
Weierstrass behaviour outside any circle |z| = R. The function exp z 
actually takes all values except 0 for arbitrarily large |z|. 


Exercises 12(d) 
In each of 1-8, state for what values in Z the function is singular and specify the 
nature of the singularity 
z+1 z-1 42% 
z-1 z+1 2-1 
A 


1, 
ei 
Te 
e 
“1+2 
4, tan z. 
5. tanh z. 


6. exp (tan z). 


Cee | 
7. sin: 
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|z|. (cos z has no exceptional value such as 0 is for exp z.) 


NOTES ON CHAPTER 12 


§12.7. Definition of residue of f at «©. If f has a Laurent expansion valid for 
|z| > R, and @_, is the coefficient of 1/z in it, then —a_, is defined to be the 
residue of f at 00, 

We have come to expect the occurrence of residues only at singularities. This 
definition assigning, as it does, a residue to the function 1/z which is regular at 00 
seems perverse. The rationale of it is that the role of the residue of fat a point Zo 
is to pick out the part of the function which has a non-zero integral along a 


a 
circuit round zo. For instance, the residue at z = 0 of 5) a,z" (with sum f(z) for 


j -e 
F nen [4 
where C is (say) a positively oriented circle with centre z = 0. Positive orientation 
is equivalent to the point 0 lying on the left as the circuit is traversed. Now a 
circle |z| = R is a circuit round z = ©, and, to keep © on the left, it must be 
traversed clockwise. (The Riemann spherical representation §10.4 illustrates 
this.) Thus we arrive at the definition of the residue at oo as being —a_,. 
The introduction of the residue at co would have the following consequence. 
If a function has a finite set S of singularities in Z, the sum of the residues at 
points of S, with oo included, is zero. 


0 < |z|) isa_, and 


§12.8. Some writers attribute theorem 12.8 to Sochozki. 

Picard’s theorem. Theorem 12.8 shows that an entire function (other than a 
polynomial) assumes values arbitrarily close to any assigned number. We noted 
that the special function exp z is, by choice of z, equal to any assigned number, 
except 0, and does not merely take values near to it. This is a general truth for 
entire functions, discovered by E. Picard (1856-1941). His original theorem 
(1879) was that a function meromorphic in Z which omits more than two values 
is a constant. The proof depended on assuming, on the contrary, three values to 
be omitted, projecting them into 0, 1, 0 and then drawing on knowledge which 
was already available about a class of functions (elliptic modular functions) 
which fail to take just those three values. Picard’s theorem led to a vast literature 
in which the names of Landau, Schottky, Bloch, R. Nevanlinna and F, Nevan- 
linna are prominent. For a text-book account of the subject (which is impossible 
for us to broach) see, for instance, Hille, Analytic Function Theory, vol. 1. 
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GENERAL THEOREMS. ANALYTIC 
FUNCTIONS 


13.1. Regular functions represented by series or integrals 

The outlook in this chapter is wider than in chapter 12, and some 
of the results are more general than are needed in every-day analysis. 
The reader who is primarily interested in applying his knowledge 
to special functions can read chapter 14 with occasional reference 
back to the present chapter. 

Taylor’s theorem 12.11 exhibited a regular function as the limit 
of a sequence of polynomials. Laurent’s theorem 12.31 allowed 
negative as well as positive powers of the variable. The present 
section contains representation theorems in a much wider setting. The 
first, due to Weierstrass, replaces Taylor’s series in powers of z by a 
uniformly convergent sequence of functions on which the sole 
restriction is regularity. 


Theorem 13.11. Suppose that (i) for each n,s,(z) is regular in the 
region D; and (ii) on every compact subset of D, s,(z) tends uniformly 
to s(z) asn tends to «©. Then (1) s(z) is regular in D, (2) the derivative 
of any order p satisfies s”(z) = lim s?(z), 


Proof. Let a be any point of D. Choose r small enough for the 
closure of the disc B(a;r) to lie in D. Then s(z), the uniform limit 
of the sequence of continuous functions s,(z), is continuous in B(a;r), 
and so at every point of D. 

We shall use Morera’s theorem 11.92 to prove that s(z) is regular. 
Let y be any circuit in B(a; r). Since s,(z) tends uniformly to s(z) 
on y, we have, from theorem 11.12, 


if S,(z)dz > 1 s(z)dz. 


For each n, the left-hand side is 0 (by Cauchy’s theorem 11.5). 
So the right-hand side is 0 and, by Morera’s theorem, s(z) is regular 
in D. 

To prove (2), let C = C(a; r) be the circular boundary of B(a; r), 
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positively oriented. Then, since s,(¢) > s(¢) uniformly for ¢ on C, 
and (€—a)~”- is bounded on C, 


Sn) s($) 
dg = o(—a)rtt dé. 


iim o(E- aja 


Multiplying by (p!)/27i, we have (2)..| 
Corollary 1. The convergence of s\?\(z) to sz) is uniform on every 
compact subset of D. 


Proof. We refine the proof of (2). Let z be any point in the closure 
of the disc B(a; 4r). Then 


lim I goa - |, _s(Z) dt, 


nro J o($—z)?*# (¢-2)?# 
since now |¢—z| > 4r. This gives 
lim s?(z) = sz) 
uniformly on the closure of the disc B(a; 4r), that is to say, given e, 
|sP(z)-s(z)| <€ if n> N(e,a) and ze B(a; 4r). 
Let now K be a given compact subset of D. By the Heine-Borel 
theorem 3.7, a finite number of points a can be found such that the 
(open) discs B(a; 4r) associated with them cover K. 


If N is the greatest of the corresponding numbers N(¢, a) defined 
above, we have 


|sP(z)-—s™(2)| < € if n>N, forallzinK. | 


Corollary 2. The hypothesis (i) of the theorem may be replaced by 
(i)’ s,(z) is regular in D,, where Dy, © Dyis(n = 1,2,...) and 
D = UD,,. 


Proof. At each stage of the proof of the theorem we are working 


with a compact set, say K. If K < U D,, then, by the Heine-Borel 
1 


N 
theorem 3.7, K < UY D,,. Since D, © Dyi1, we have K < Dy. We 


ignore those s, for which n < N and argue as in theorem 13.11. | 
Illustration. 5,(z) = ras +1 


is regular in D,, the disc |z| < 2-1/", s(z) = zin |z| < 1. This example is given by 
Ahlfors, Complex Analysis (p. 174). 
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Theorem 13.11, defining a regular function as the limit of a 
sequence (or as the sum of an infinite series) will have a parallel in 
which summation over the positive integers is replaced by integration 
with respect to a continuous variable u. We suppose u to be real, as 
it usually is in practice; the extension to a complex variable and a 
prescribed path of integration is straightforward. 

We state two theorems about the regularity of a function repre- 
sented by an integral, in the first over a finite interval and in the 
second (the analogue of theorem 13.11) over an infinite interval. 


Theorem 13.12. Let s(u, z) be a continuous function of the pair (u, z) 
for0 <u <1,z inaregion D. Let s(u, z) be regular in D for each u. 


Then 1 
fle) = [stu 2)du 


is regular in D, and its derivatives are given by 
y nie di 
fez) = [ ie s(u, z) du. 


Proof. Since s is continuous, fis continuous in D. 

As in theorem 13.11, given a disc in D we take in it a circuit 
with a representation z = z(¢). Then, since the integrand is continuous 
in (u, z) and the integrals along y are real integrals with respect to ¢, 
it can be seen from theorem 8,31 that 


f. du i S(u, z)dz = ig dz ik s(u, z)du. 


The left-hand side is 0, since, by Cauchy’s theorem 11.5, the inner 
integral is 0 for each u. Therefore the right-hand side, namely 


J J(z)dz, is also 0. By Morera’s theorem 11.92, fis regular in D. 
# 


To prove the formula for /, let C be a circle with centre z lying 
in D. From theorem 11.91 


f(z) = Boos dt 


2ni 


Pp! de 
= Flea Pr, 4 Ode 


The integrand of the repeated integral is continuous in (u, ¢) and 
we may invert the order of integration, obtaining 


frye = fou zd | 
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Theorem 13.13. Let s(u, z) be a continuous function of the pair (u, z) 

for u > 0 and for all z in D. Let s(u, z) be regular in D for each u. 
0 

Suppose that, on every compact subset of , | S(u, z)du converges 
0 


uniformly to f(z). Then f(z) is regular in D and 
y gad a 
f(z) = ii ap S(u, z)du. 
Proof. The only modification needed in the proof of theorem 


13.12 is to appeal to uniformity of convergence of iF s(u, z)du to 


assert the continuity of fand to justify inverting the repeated ya is 
in which it occurs. | 


An alternative extension of theorem 13.12 caters for unbounded- 
ness of the integrand s(u, z), say as u->0+, instead of integration 
of s(u, z) over an infinite range [0, 00) in theorem 13.13. 


Exercises 13(a) 


1. Investigate in what regions of Z (if any), the following limits of sequences (or 
sums of series) represent regular functions: 
pomhie ae jt - Zts5) 
One Ser) ese > mn me 


1 JQ). Hy TG wh 


= ne sin nz 


(viii) Se 
1 


(vii) 


2. Investigate as in 1 these integrals: 


‘Qn 2 
@ ih won (ii) [feo -a9a, «io f exp (—zt*) dt, 
1 gj: D of 1 gj 
w a w [Pata wi) a, 
(vii) rs ize ely) ne Jim a <a (a + 0). 


3. Functions f, g are given which are regular in Z. From 1 (i) or otherwise 
construct a sequence ¢, such that 


lim ¢,(z) = 


no 


on if |z| <1, 
g(z) if |z| > 1. 
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4, Show that, for every fixed N, 
sa il 


Fu@) = 3 Gita Giz) 


converges uniformly on the annulus 1/N < |z| < N. Deduce that F,(z) is regular 
except for certain singularities, and state the nature of the singularities. 


es) 

5. In theorem 13.13 prove that the convergence of i @?s(u, z)/2z?du to f(z) 
0 

is uniform on every compact subset of D. 


6. Apropos the remark following theorem 5.62, give an example of a function 
of z continuous in a domain D which is not the uniform limit of a sequence of 
polynomials in z. 


13.2. Local mappings 


The results of chapter 12, particularly §12.6, enable us to analyse 
the local properties of the correspondence effected by w = f(z). We 
studied simple examples in chapter 10, Throughout this pecton we 
shall assume that fis not a constant. 


Theorem 13.21. Let f be regular at a, and let f(z)—b have a zero of 
order n for z = a. Then, if € is small enough, there is a corresponding 
6 such that, for every b' in the disc |\b—b'| < 4, the dise |z—a| < € 
contains n zeros of f(z)—b'. 


Proof. The zeros of f being isolated (§12.1), we may suppose ¢ 
small enough for a to be the sole zero of the regular function f/—b 
in the closed disc |z—a| < «. 

We can take 6 > 0 such that 


If@-8| > 8 
for every z on the circle |z—a| = ¢. 
Let b’ satisfy |b—b'| < 6. 
By Rouché’s theorem 12.62, 
f()-b and {f(z)—b}+{b-b} 
have the same number of zeros inside the circle |z—a| = ¢. The 
former has n zeros and therefore so has f(z)—b’. | 


Corollary 1. A function regular on an open set G and not constant on 
any of its components maps open subsets of G onto open sets. 


Proof. With the notation of the theorem, if f is regular at a, and 
f(a) = b, the z-disc B(a; ) is mapped onto a w-set containing the 
disc B(b; 6). | 
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Corollary 2. If fis regular at a and f'(a) + 0, there is a neighbourhood 
of ain which w = f(z) has an inverse mapping regular at b = f(a). 


Proof. Since f'(a) + 0, we have n = 1 in theorem 13.21. By con- 
tinuity of f’, we can take the ¢ in the theorem small enough for f’ to 
be different from 0 in the disc B(a; €). 

There is a bijective mapping of B(b; 6) onto an open subset G of 
B(a; 6) containing a. The function f restricted to G has an inverse 
g and, by corollary 1 and theorem 3.23, g is continuous. 

Given b, and w, in the disc B(b; 6), there are unique a, and z, in 
G with g(b,) = a, and g(w,) = z,. Then 

g(w1) —g(b,) SeowB 
Ww, — by Sa) fax)’ 

Let w, > b,. Since g is continuous, z, > a, and the right-hand side 
tends to 1/f’(a,), since f'(a,) + 0. Hence g’(b,) exists. Since b; is an 
arbitrary point in the disc B(b; 6), g is regular at b. | 


Theorem 13.21 yields a basic proof of the Maximum Principle 
(which is already contained in exercise 12(a), 14, a deduction from 
Cauchy’s integral formula. See exercise 13(b) 7(ii).) 


Theorem 13.22, (The maximum principle.) [ff is regular in a region 
D (and not constant), then \f| does not have a maximum in D. 


Proof. If a is a point of D, and b = f(a), then any disc A (in D) 
with centre a is mapped onto an open set G containing b. G contains 
points with modulus greater than |b]. | 


Corollary. If f is regular at every point of a compact set E, then 
|f| attains its supremum at a frontier point of E. 


The maximum principle has many consequences. As illustrations 
we append theorems 13.23 and 13.24. 


Theorem 13.23, (Schwarz’s lemma.) Suppose that f is regular and 
|f(2)| < M for |z| < R, and that f(0) = 0. Then either 


Ie) < MEI for o< [el <R 


or S@ = Me zole (« real). 


Proof. We may take M = R = 1, and the general case will then 
follow by applying that result to f(Rz)/M. 
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Write g(z) = f(a/z for z+0 and g(0) =/'(0). 

From theorem 12.4, g is regular for |z| < 1. 

Given any point z) with |zo| < 1, let |zo| < r < 1. Then there is 
at least one value z, with |z,| = r such that 


\f@)| < 
|e(z0)| < |g(zD| = la| “eG 
This is true, however near r is to 1, and therefore 
lg(zo)| <1 
If there is a € such that |g(¢)| = 1, then, by theorem 13.22, g is 
constant, say g(z) = A, where |A| = 1, and f(z) = Az. If there is no 
such &, then |g(z)| < 1 for |z| < 1, that is to say |f(z)| < |z| for 
0 < |z| < 1. | 


Corollary. With the hypothesis of the theorem either ~ 
\If'@| < MIR or f(z) = M cel, 


Proof. In the theorem, either |g(0)| < 1 or g(z) = A, where 
|A| = 1. From this the inequality for | f’(0)| follows. | 


The next theorem gives finality to §10.5 (8). 


Theorem 13.24, Every bijective conformal mapping of a disc onto 
another is bilinear. 


Proof. We lose no generality by taking the discs to be |z| < 1 and 
|w| < 1. 

(i) We prove first that, if z = 0 is mapped into w = 0, the mapping 
is w = ze’ (« real). 

Denote the mapping by w = f(z) and its inverse by z = g(w). 

Then @| <1 if |Z) <1. 

By theorem 13.23 (corollary), 

either |f’(0)| <1 or f(z) = ze™. 

Similarly |g'O)| <1 or g(w) = we, 

Since f'Ms'® = 1, 
we must take the second alternatives. 

(ii) Let the mapping w = L(z) transform |z| < 1 onto |w| < 1 
with LO) = Wo. 
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From §10.5 (8) the transformation 
WW 


¢=T(Ww) == 


wow-1 


maps || < 1 onto |g] < 1. 
The compound transformation ¢ = T{L(z)} maps the disc |z| < 1 
onto |¢| < 1 with z = 0 mapped into ¢ = 0. By (i) of this proof, 


T{L(z)} = ze, 
Therefore L(z) = T-\(ze) 


_ Wo-zem@ 
1-woze 
which is bilinear. | 


Exercises 13(5) 
M(r) always denotes sup |f(z)| for |z| = r. 


1. Calculate M(r) for the functions 
. pore vi be is (-1)"2" 
(i) exp iz, (ii) sin z, Gi) sits tone 


2. Prove the minimum principle: if f is regular and not constant in a region D, 
then |f| can have a minimum in D only at a zero of f. 


3. If f is regular in B(O; R), where R > 1 and M(1) < 1, prove that there is 
just one point zp in BO; 1) for which f(z») = zo. 


4, If fis a polynomial of degree n, prove that 


M(ry) . M(rs) 
my” or 


for 0 < r; < rs, with the sign of equality only if f(z) = az". 


5. f is regular and bounded in B(0; 1). As r+1—, f(re'%) +0 uniformly for 
a <6 < £. Prove that f = 0. 


6. The three-circles theorem of Hadamard (1865-1963). Let f be regular for 
r < |z| < rs. By applying the maximum principle to z?{f(z)}* for suitable p, g, 
prove that, for r; < r < rs, 


M(r)!8(rIrd <M (11) 108(I9) M4 (r,) 108 (F'n), 


Verify also that log M(r) is a convex function of log r. (A function is convex if 
the are joining any two points is below (or coincides with) the chord.) 
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7. Let f be regular in B(O; R) and write 


2: 
LO= x | eemdo O<r< RB. 


(See also exercise 12(a), 14.) Prove that 
(i) 1,(r) is a continuous, increasing function of r, 
(ii) |f()|? < 1,(r) < {M(*)}, and deduce theorem 13.22, 
(iii) log ,(r) is a convex function of log r. 


13.3. The Weierstrass approach. Analytic continuation 


We now look more closely into the foundations of complex 
function theory. The development in which the integral theorem 
J fdz = 0 takes the central place is due to Cauchy. Other avenues 
of approach were followed by Riemann and by Weierstrass. As a 
prologue to the rest of this chapter the reader should look again at 
the discussion in §10.2 of the two values of w arising from w* = z 
and at the uniqueness theorem 12.13 for regular functions. 

Weierstrass developed complex function theory using power series 
as the standard representation of a regular function (in the circle of 
convergence). It may help the reader if the general discussion is 
accompanied by examples chosen to be as simple as possible. 

Suppose that we are given a regular function f defined in a region 
D. An immediate question is—can the domain of definition of f be 
extended to points outside D? 

Keeping theorem 12.13 in mind, let us agree on terminology and 
state some facts, 


Definition. A regular function f defined in a region D will be called 
a function element, written (f, D). 

Suppose that (fo, Do) and (f;, D,) are function elements, where Dy 
and D, have common points. Then Dy f D, is open; without restrict- 
ions on Dy and D, it need not be connected. If Dy and D, are 
convex, as we shall always in future assume, Dg f D, is connected. 

Suppose that f(z) = f(z) for all z in Dyn Dy. 

Then (f, Do U D,), where f = fo in Dy and f = f, in D,, is a function 
element. 


Definition. With the assumptions just made, each of (fo, Do), (fi, D1) 
is called a direct analytic continuation of the other. 

It may be possible to go on with this process and form a chain of 
function elements 


(fos Do)s (fis D1)s -++5 Fn» Dn) 
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of which each (after the first) is a direct analytic continuation of the 
preceding one (each D convex). 


Definition. Any two function elements of such a chain are called 
analytic continuations of each other. 


Example 1. 
f(z) = 1+(1-2) + (1-2)? +... + (1-2)"+ 


D, is the disc |1—z| < 1. 

This example is artificially simple because the power series defining 
fo is a geometric progression which, for z in Do, can at once be 
summed to the rational function 1/z. So the problem of extending 
the definition of f, outside Dy can be solved by declaring that f(z) 
shall be 1/z for all z except the singularity z = 0. But if the series for 
fo had been one without a simple formula for its sum, we could have 
taken 


+P 
3 


AZ) = 


with D, the disc “e < |a|, that is to say the interior of the circle, 
centre a, through the origin. 

If a is not real, D, contains points outside Dy and f, = fo in 
Don Dy. 


2. 
fe) = 1-1-2) 7 1-2). SF ap, 


D, is the disc |1—z| < 1. 
Again we have chosen a series whose sum is an elementary function, 
to enable us to visualize more clearly the process of continuation. 
In this example let us write g(z) = ,/z if, in some specified domain, 


eG)? = 2. Then 42) = (1-1-2 = 


the principal value of ./z in Dy (see exercise 12(a), 1). e 5x. 

Now construct a chain of function elements. We can take, for 
instance, the region D,, to be the interior of the circle with centre 
exp }nmi and radius 1. Each D,, overlaps the preceding one, and D, 
is the same region as Dy. As we take a sequence of values of z (say, 
lying on the circle |z| = 1) in the regions common to the pairs 
Dy, Dy; Dy, De; ...; Ds, Do, then Jz, starting at z = 1 with the value 
1 will return to z = 1 with the value —1. 
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So the function elements (f, Do) and (fg, Ds) are different although 
the regions D, and D, are the same. If we pursue the process of 
continuation through D,, ... to D,., making a second circumnaviga- 
tion of the origin, the function element (f,, D1.) taking the value +1 
at z = 1 is the same as (fo, Do). 


The only restriction so far laid on the region D in which a function 
element is defined is convexity. In writing (f, D), where D is a disc, 
we do not suppose, unless we say so explicitly, that D is the largest 
disc in which fis regular. In particular, if fis defined by a power series, 
D may be its disc of convergence or any disc (not necessarily con- 
centric) inside it. 

We go on to prove a simple theorem (13.3) bearing on the question 
whether (f, D) possesses direct analytic continuations to points 
outside D, We shall then give exammules ct funttion el elements which 
have no such continuations. 


Theorem 13.3. Let D be the disc of convergence of a power series with 
sum f. Then there is at least one point b on the frontier of D such that 
(f, D) has no direct analytic continuation (f,, D,) for. which b € D,. 


Proof. Let D be the disc B(a; R). We have to prove that there is a 
b with |b—a| = R for which there is no disc D,, with centre 6, in 
which a function element (f,, D,) continues (f, D). Suppose, on the 
contrary, that there is no such b. Then, by the Heine-Borel theorem 
3.7, there are n elements (f;, D;) each continuing (f, D) such 


n n 
that U D, contains every point of |z—a| = R. The set U D; covers 
| 1 


an annulus R, < |z—a| < R,, where R, < R < R,. We have to 
show that /,(z) = f,(z) for z€ D;n D;. This follows from theorem 
12.13, since, if D;n D; + @, then D;n D;n D + @ and 

Fi) = f@ =f 
for z€ D,n D;f D. The functions f; thus define a function regular 
in the disc B(a; R,), and so the power series for f converges in this 


disc. This contradicts the assumption that R was the radius of con- 
vergence of f. | 


In examples 1 and 2 above there is no direct analytic continuation 
into any region containing z = 0. In 1 this point is a pole of the 
function represented by the power series, in 2 a branch point (see 
§10.2). 
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Example 3. The power series 
F(z) = 14+z4+22+28+...42M 4+... 


cannot be continued to any point outside its circle of convergence 
Jz] = 1. 

Proof. Let p/q be a rational number. 

Let z = rexp (277i p/q), where r takes values tending to 1 from 
below. 

q-1 o 
Then {@ = DT A+D". 
0 q 
The second sum on the right tends to oo as r tends to 1, and so | f(z)| 
tends to © as z tends to exp (27i p/q) along the radius. 

Let D be a region containing points of B(0; 1) and of its comple- 
ment. Then D contains points exp (27i p/q). Any function (g, D) 
which coincides with f in Dn B(O;1) is discontinuous at these 
points exp (27i p/q). So there can be no continuation of f outside the 
circle. | 


In example 3, the circle |z| = 1 is a natural frontier of f. 


13.4. Analytic functions 

In attaching the word regular to a differentiable function (§10.2) 
we said that the term analytic function was being reserved for a wider 
meaning, which we now explain. 

The relation of being analytic continuations of each other is an 
equivalence relation between function elements. This fact serves to 
define an analytic function. 


Definition. An analytic function is an equivalence class of function 
elements. 

If, for each value of z for which it is defined, an analytic function 
has one value only, it may be called one-valued or uniform. 

If there are values of z for which function elements have different 
values, the analytic function is multiform (or many-valued). 

Analytic continuation along a curve. Let y be a curve given by 
z = 2(t) for 0 < t < 1. Let (fo, Do) be a function element defined in 
a disc Dy containing z(0). Let 

0 =f <<. < thy = 1 


be a dissection of [0, 1]. Suppose that there is a chain of function 
elements (f;,, D,) such that the arc z,= z(t) for 4, < t < ty4, lies in 
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the disc D,(k = 0, 1, ... m). We say that the function element (f,,, D,,) 
is obtained from (fo, Do) by analytic continuation along the curve y. 

To justify this definition we have to prove that such analytic con- 
tinuation is unique in the sense of the next theorem. 


Theorem 13.41. If (fo, Do)s «+s (fns Dn) and (Go, Ao), «+» (Pms Am) are 
chains of function elements along a given curve and f(z) = $9(z) for 
zé Don Ag, then f,(z) = $,(2) for z€ D, N An. 

Proof. Suppose that the dissections 

Om ty < te < ty = 1 
and Qe rs <7... < Teg = 1 
are such that the arcy[t; t4,] < Dj <i<n) and the arc 
W75 Ti+] < AVO <j < m). 

The theorem is true if we prove that if the intervals [t;, t;,,] and 
[7;, 7j41] have a common point then f(z) = ¢,(z) for ze D;n A;. 
Suppose that there are values of i, for which f,; = ¢, in the non- 
empty region D; n A;. Take those for which i+/ is least. Suppose that 
t; > 7; Then i > 1 and the point z(¢,) lies in D;_.n D;n Aj. Since 
i+/ is minimal, it follows that f;_, = ¢; in D,-; 0 Ay. But f;. =f; in 
D,-1 9 Dj. 

Therefore f; = ¢; in the non-empty region D,;_, D;n A;. But f, 
and ¢, are regular in the region D; A;. By theorem 12.13 f, = ¢; 
in D;nA;. This contradicts the definition of i, j. | 


Continuation along homotopic curves. Suppose that analytic con- 
tinuation of a function element (fo, Do), where z) € Do, is possible 
along two different curves y, and y joining z, to a point z. We enquire 
whether both curves lead to the same function element (f, D), where 
zeéD. The nature of analytic continuation as a procedure based on 
overlapping regions suggests the likelihood of the two curves leading 
to a common function element if one curve can be continuously 
deformed into the other, that is to say, ify) and y are homotopic with 
the fixed end points zo, z (as defined in §11.6). 

We first deal with curves in a disc. 

Theorem 13.42. Let A be a disc containing Do. Suppose that (fo, Do) 
can be continued along every curve in A. Then the analytic function thus 
defined is one-valued in A. 


Proof. Let € be the centre of A. Let zy be a point of Do. Continua- 
tion along the straight segment [zo, ¢] leads to a function element 
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(f, D) where e D. Take a disc D,, with centre ¢, contained in D. 
Then f may be supposed to be represented by its Taylor series about ¢. 

By hypothesis we may pursue the continuation of (/, D,) along 
any radius of A. By theorem 13.3, the Taylor series converges at 
all points of A. | 


The extension from a disc to a more general region can now be 
made as in Cauchy’s theorem. 


Theorem 13.43. (Monodromy.) Suppose that, in a region D, two 
curves Yo, ¥ are homotopic with fixed end points zo, z and that (fo, Do), 
where zy € Dy, can be continued along all curves in D. Then continua- 
tions along y) and y lead to a common function element in a region 
containing z. 


Proof. We operate with the discs B,; and curves y;;, 7; defined in 
theorem 11.61. By theorem 13.42, continuation along the curve 7,; 
is equivalent to continuation along 7;;, ¥;,;41, —Mi+1,; in order. Fix 
jand let i take the values of the ¢-dissection. Then continuation along 
y, and 7;,, lead to a common function element in a region containing 
the final end point z. This is then true for y, and y. | 


The most useful special case of theorem 13.42 is the following. 


Corollary. If D is simply connected and (fy, Do) can be continued 
along all curves in D, the analytic function thus defined is one-valued 
in D. 

Exercises 13(c) 
1. Which of the following functions on —1 < x < 1 have regular extensions to 


regions in Z; : 
. : xe, sinx, tan4mx, cos |x|? 


2. Prove that, if f@=S2" (el <2, 
n=0 
then S(@) = z+f(2"). 


Deduce that f cannot be continued over the unit circle. 
3. Assume that, if x > 0, then 


[estar = wer 


(proved in § 8.6). 
Investigate the extension to z = x+iy, and by letting x > 0+, obtain the 
formula, with y > 0, 


se cos yt*dt = 4,/(77/2y). 
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«© 

4. Prove that, if a, > 0, and f(z) = §} anz” has radius of convergence 1, then f 
0 

cannot be continued over the point 1. 


5. Prove that an analytic function can take at most a countable set of values at 
a given point. Mention two functions for which the set of values is infinite. 


% 
6. Prove that the Riemann zeta function defined by &(z) = })n-* is regular if 
1 


x > 1,and ¢(z) defined by }) (—1)""n-* is regular if x > 0 (n® having its principal 
1 


value). 

Prove that the function ¢(z)/(1—2'-*) provides the analytic continuation of 
&(z) into the punctured region x > 0, z + 1. Prove that (z) has a pole at z = 1 
with residue 1. 


7. The function fis regular in a region D which contains the segment 0 < x < 1, 
y = 0. f(z) is real valued on the segment0 <a<x<b<1,y=0. 

Prove that the coefficients of the Taylor expansion of f about the origin are 
real. 

Show that this conclusion may be false if it is only known that D contains the 
point z = 0 and the segmenta < x < b,y = 0. 


NOTES ON CHAPTER 13 


§ 13.2. It is interesting to compare this section with §7.5 on mappings from 
R" to R", Since regular functions are much more specialised than general 
differentiable mappings, the hypotheses in theorems can be less restrictive. For 
instance, the corollaries to theorem 13.21 hold without the assumption that 
f(z) + 0; to prove theorem 7.52 we have to suppose that the Jacobian is not 0. 


§ 13.4. The Riemann surface. Consider example 2 of § 13.3 which illustrates a 
selection of the function elements which generate a multiform analytic function. 
To visualize the mapping which it effects, it is not adequate to set up a single 
plane Z as the carrier of the variable z. Rather, we need two planes Z, one super- 
posed on the other and having connecting bridges. The reader should compare 
the present section with § 10.2 in which the two branches of ./z were kept 
separate by the veto on analytic continuation across a fixed ray from the origin 
(the negative real axis). 

We will now form a picture of the analytic function defined by w* = z. 
Corresponding to any value a of z, there are two function elements (the two 
square roots of z) each of which is expressible as a power series in z—a conver- 
gent in a disc with centre a and radius |a|. Imagine these discs made of paper. 
The value of a function element at a given value of z may be thought of as being 
marked on the paper. When two function elements are direct analytic continua- 
tions of each other, we suppose their discs to be glued together. In example 2, 
the disc for Dg will not be glued to Do, but Dy, is to coalesce with Dy. A model 
made of paper runs into difficulties because surfaces have to pass through one 
another. There is no trouble about this in an abstract definition of the surfaces. 

So, for the ‘two-valued’ function z?, we picture two planes, Z, being super- 
posed on Z, and joined along the negative real axis in such a manner that a point 
in Z, describing (say) the circle |z| = 1 anticlockwise from the point 1 steps up 
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into Z, on reaching the value z = —1 and, after going again round the circle 
{z| = 1, steps down into Z, on reaching z= —1. The purpose of this imagery 
is to design a structure, a Riemann surface, carrying the variable z on which the 
analytic function w is a continuous function of z. 

The model would be more informative if we include z = 00 and take extended 
planes Z, and Z,. The points (branch-points) z = Oand z = lie in both planes 
and the planes have bridges leading from each to the other along some specified 
line (say the negative real axis) joining 0 and 00. Instead of extended planes, the 
spherical representation could be used. 


14 
APPLICATIONS TO SPECIAL FUNCTIONS 


14.1. Evaluation of real integrals by residues 


In this chapter we apply to special functions the methods and 
theorems of complex analysis (mainly to be found in chapter 12). 

The theorem of residues 12.5 can be used to calculate real definite 
integrals of various types including many which have no indefinite 
integral expressible by standard functions. 

We shall take four examples. The first two are of the form 


i r(x) cos (or sin) mxdx, 
0 


where r(x) is a rational function. 

The following remark enables us to write down at sight the residue 
of a function at a pole of the first order. 

If flg has a simple pole at z =a, with g(a) = 0, f(a) + 0, its 
residue there is f(a)/|g'(a). 


{@ _ 
Proof. eae 
roof. a) 7 at h@ 
where f, is regular at a. We then have for the residue 


= jm4@E-9 _ L[@ 
a Se g@)-g@  g@’ 


The remark applies only to a pole of the first order. 


Example 1. 
SOS TIX dx, where m > 0,a>0. 
0 8+" 
: _ exp miz 
Solution. Let S@ = aye 


Let = J J(z) dz, where y is the path from —R to R of the real 
2 


axis, and R > a. Let J = if S(z) dz, where T’ is the semicircle |z| = 
i 
0 < phz < z. Then 


F cos mx+isin MX 4 Roos MX 4 
1S i. Wye = 2 gd 
x*+a x*+a' 
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The integrand fis regular for all z except simple poles at ia and —ia. 
The circuit y +I is seen to be homotopic to a point, and its index is 
1 for ia and is 0 for —ia. 

The remark just preceding this example shows that the residue of f 
at ia is exp (—/ma)/2ia. 

The residue theorem 12.5 then gives 


I+J = (n/a) exp (—ma). 


The modulus of the integrand in J is bounded by 1/(R?—a*), and so 
\J| < R/(R*—a®), and J+0 as R- ©. Collecting our results, we 
have proved that the integral asked for is (7/2a) exp (—ma). 

Notes. (1) The essence of the proof that J > 0 could be written 


J = O(1/R®)O(R) = O(1/R) > 0. 


(2) Where is the hypothesis m > 0 used? What is the value of the 
integral if m < 0? 

(3) In setting up the complex integrand f(z), could we not replace 
cos mx by cos mz instead of bringing in the exponential function? 


Example 2. Prove that 


” sin x 
i — dx =n. 
0 x 


Preliminary survey. If we follow the method which was successful 
in example 1, the best upper bound that we can offer for the integrand 
on the large semicircle is O(1/R) and for the integral the bound O(1). 
But we need the closer estimate o(1) for the integral. This calls for 


an argument more delicate than the boundedness of if St | by the 
x 


maximum of | f| multiplied by the length of I’. The extra delicacy is 
a reflection of the divergence of the integral 


fc sin x| i 
0 x 


The following lemma supplies the necessary refinement. 


Lemma, (Jordan’s lemma.) Let g(z) be continuous for |z| > c, 
0 < phz < 7; and let Mx be sup |q(z)| on T, the semicircle |z| = R, 
0 < phz < z. Let m > 0. Then, as R> ©, 


fw exp mizdz = O(MR). 
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Proof. Let I = \ q(z) exp mizdz. Then 
r 


[| = 


\ "G(R exp 10) exp {miR(cos 0+ sin 4)}iR exp 100 
0 
< Mp {exp (—mR sin 6) Rd0 

0 


bn 
= 2Mz exp (—mR sin 0) Rdd. 
0 
But sin 6/6 decreases in 0 < 0 < 47 and so sin 8 > 20/7. Hence 
40 
|| < 2M exp (—2mR@/m) Rdd 
0 
oh eee it mM 
= 2Mr =| exp ( 2mR6|n)) anne | 


Corollary. If, as |R| > 0, q(Re') +0 uniformly for 0 < 0 < 7, then, 

as Ro, 

f q(z) exp mizdz > 0. 
r 


Another useful lemma is relevant to example 2. 
Lemma. If f has a simple pole at z = a, with residue b, and y is the 
path z = a+de where a < 0 < f, then the limit asd >0 of { Sis 
ib(B—a). : 
Proof, fe) = +80) 
where |g(z)| < M. 


7 
at gh -/ ibd®, fe = 06). | 
a Y 

Solution of example 2. Let f(z) = ope f 


Let j= f Jf, where y is the semicircle z = de(0 < 6 < 7), 
Y 


J= i F, where I is the semicircle z = Re (0 < 6 < 7), 
Tr 


= ; 
and let 1 = ([ +{°) 27 ax 
-R é x 
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By Cauchy’s theorem 11.63, 
I-j+J =0, 
the circuit being homotopic to a point and having index 0 for z = 0 
the only singularity of f. 
As 6-0, the last lemma shows that j > zi. 
As R >, J > 0 by Jordan’s lemma. 


As 8>0 and R-> 00, 1->2i[ “2% de. 
0 


This completes the evaluation of the integral by the residue 
theorem. There are several alternative approaches, of which two 
have been given in §6.9 and §8.7; and we have referred at the end 
of chapter 8 to Hardy’s assessment of the various methods. 


Example 3. 2 gan 
(4 Va 
This example is chosen to illustrate (i) technique for a pole of 
order higher than the first, (ii) exploitation of periodicity in (part of) 


the integrand. 
Solution, Put 


where 0<a<2. 


em 
S@) = @rp 


Integrate anticlockwise round the rectangle whose corners are 
+X, +X+2z7i. 

f(x+2mi) = et f(x), so the integrals along the two horizontal 
sides combine to give 


d= ery [ F(x) dx. 


On the right vertical side |f(z)| = O(e¢-*) and on the left 
vertical side | f(z)| = O(e-**). As X > 00, the integrals along both 
the sides tend to 0. 

The singularities of f are double poles where z is an odd multiple 
of zi. The rectangular circuit has index 1 for 7i and 0 for all others. 

Put z = i+ ¢ and expand / in its Laurent series in ¢. The residue 
is the coefficient of ¢-1 and that is all that we need to know. 

We have, using a special case of theorem 5.44, 


S(mi+ §) = et"(1+af+...)(—6-40-...)? 
oat (lapel 
=e (a+ t +). 


Thus the residue is e*”*(a—1). 
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Letting X + oo, we have 
(G—e*") i * food = 2nie*"(a—-1) 


m(1—a) 
sin am * 


and hence i IT (x)dx = 


Ifa = 1, the last line but one says 0 = 0. The integral is then element- 
ary, by the substitution e* = u, and its value is 1, which is in fact 
the limit of 7(1 —a)/sin az. 


xP- 1 
Example 4. i= po where 0<p<l. 


Observe that the conditions p > 0 and p < | are necessary and 
sufficient for the existence of the integral at 0 and oo respectively. 


The general type, of which this is a specimen is f x?-1q(x) dx, where 
0 


q(z) has no singularity on the positive real axis x > 0. 

The feature of this example is that z?—1 is multiform, z = 0 being 
the branch point. To avoid ambiguity we must specify a branch of any 
multiform function and keep to it. 

We shall deal with this example 
exhaustively—by three different 
methods. 

Method (i). In the diagram the 
large and small circles have radii =) 7 
R, 6. The angle BOC is a, where SEZ. 

OM ar<in, 

Let I’, be the circuit composed 

of AB, arc BC (anticlockwise), 
CD, arc DA (clockwise). 
Let I’, be the noe DC, CB (anticlockwise), BA, AD (clockwise). 


Define f,(z) = a where z?-! has its principal value. Then there 


is a simply caiebes region containing I’, and excluding the origin, 
in which f, is regular. By theorem 11.62, 


We now need a function f, in a ORE containing I’, and agreeing 


with f, along CD. Define /,(z) = with z?-1 = r?-! exp (p—1) 6, 


oo 
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where z = re and (say) a—7 < 6 < 2m+y (taking 0 < 7 < 44). 
The function fy is regular except for a simple pole at z = —1, where 
the residue is exp (p—1)zi. By theorem 12.5, 


i Se = 2ni exp (p—1)7i 
ba 
= —2zi exp pri. 
Observe then that, on BA, 
, xP-1 y 1 < 

SAX) = Sy Ox Ap — Wri. 

Take f+f So 
rT r 

The integrals along CD, DC cancel. The integrals along the arcs 


of the outer circle are O(R?-*) and along the small circle O(6”). 
Letting 6 > 0 and R - 00, we have 


p— so 
a — eon [S = —2niert 
oy p—1 
and hence f GS pee 
o xt+1 sin p7 
Method (ii). By the change of variable x = u* we have 
a ae 
i) AES Ma 


The reader can verify that he can integrate the function z?”?~*/(z?+ 1), 
where aS 1 is ree defined, round the circuit composed of 
—~R <x < —d,8 <x < Rand the two semicircles with radii R, 3 
in the a half ati The residue at the pole z = / is 


(1/2i) exp (2p — 1) 477, 
which is —4 exp pzi. 


Method (iii). The substitution x = e" gets rid of the multiformity 
of the integrand and yields an integral of the type of example 3. 


Exercises 14(a) 


PIT XN: Tere. 
1. Prove that er Sacre 


(Choose a circuit for your complex integral which includes one pole, not four.) 
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pee 
I= i Ten = ce: 


2. Evaluate 


Deduce that J, > 1 as n > 00. Also prove this from the definition of J,, without 
calculating its value. 
3. Prove that, ifa > 0,b > 0,a+ 6, 
it s dx m(2a+ b) 


— a (x*+a*)*(x2+6%)  2a%b(a +h)?" 
Is the formula valid for a = b > 0? 


4. Prove that, ifa>0,k > 0, 
© x8 sin kx 
0 6(x*+4at 


What is the value of the integral for other real values of k? 


dx = 47e-** cos ka. 


5. In example 2 of §14.1, prove that, instead of using Jordan’s lemma for the 
semicircle z = Re? (0 < 0 < 7) we may integrate by parts along it. Also verify 
that the semicircle may be replaced by other paths receding to infinity, such as 
the rectangular path formed with y = 0 by the lines x =+ R,y = R. 


6. Prove that, as X¥ 00, 


i cos ax—cos bx 


E 3 dx = (6-0) +0 (3) (a >0,b > 0). 


ve 
7. Prove that, if m > 0, b > 0, 


ie (x*— a?) sin mx 
0 


x(x*+ b*) 


dx = a (a+ be — a}, 


8. By integrating (1 —e-*)/z round a suitable quadrilateral, or otherwise, prove 


that 
B g-at_ g-Az A p~bt_ 9-Bs 
f dz= i - dz, 
b Zz a Zz 


where a, A, b, Bare complex, and the paths of integration are linear segments. 
Prove that, if a > 0,c > 0, 


2 e~F=CO © si T 
f e Bee atop et sin ex 7 
0 x a 0 2 
9. By integrating a suitable function round the unit circle, prove that 


iM le 7 (-1<k<1) 


lo 1—2kcosO+k 
Evaluate the integral for other real values of k. 


10. Evaluate (n being a positive integer) 


Qn Qn 
f 2089 cog (n—sin 0)dO, : e089 sin (nO —sin 0)d0. 
0 0 
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11. Prove that, if0 <a< 1, 


oe 7 
—_ «== * 
-oe* +1 sin 7a 


Deduce, or prove independently, that, if -1 < 6 <1, 


cosh bx 
j cosh x dx tym sed, 


12. Prove that, if0 <a< 1, 
wf Fac woi™ = —7 cot 7a, 
where the principal value (P) denotes 
-8 © 
tim { fof 
b—0 -2 é 
Prove that, if -7<c<7, 


© sinh cx 
dx = $tan te. 
i } tan te. 


sinh 7x 
13. Prove that, if -1<a<1,a+0,0<@<17, 


e A 
f z a= sah ee a Euler.) 
0 


1+2x cos 0+x* sin 0 sin a7 


14. By integrating (log z)*/(1+2z*) round a suitable circuit, or otherwise, prove 


that 
log x ™ (log x)* Gad 
i ia ——,dx = 0 and | pence dx = 3° 


15. If f(z) = exp 7iz*/sin 7z, prove that 
f(2)—f(z-1) = 2i exp {miz(z—1)}. 


By integrating f round the parallelogram with vertices + 4 + Rexp 47i, where 
Ris large, show that 


© 
f exp (—71")dt = 
-© 


(It was long supposed that complex integration did not help in evaluating 
© 
e~" dx, 
—o 
This integral has already been calculated on p. 285.) 
16. Integrate exp (—z*) round a sector of a circle to prove that 
ius 


2B 


Deduce that 4-/@) CS ‘os (or sin) ux dt 
Re eile) i us © lu. 


© ® 
fi cos x*dx = J sin x*dx = 
0 0 
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Exercises 17, 18 concern Fourier transforms (§9.9). 
~ 
17. If @) = i exp (—4u?) cos uxdu, prove that ¢’(x) = —x¢d(x). 
0 
Deduce that exp (—4x?) is its own cosine transform. 
Prove that x exp (— 4x?) is its own sine transform. 
18. Prove that sech x,/(47) is its own Fourier cosine transform, and that 
1 1 


exp {x(27)}—1 x(n) 
is its own sine transform. 


19. The Laplace transform. Suppose that 
© 
F(z) = i e"f(t)dt, 
0 


the integral converging absolutely if rez > c, where c > 0. Suppose that f 
satisfies sufficient conditions for the convergence at ¢ of its Fourier series. Using 
theorem 9.95, prove that, if a > c, 


1 a+iU 
Hf(t+)+f(t—)} = 5— lim [ e*'F(z)dz, 


271 U-+0 Ja-iv 


(integrating along the linear segment (a—iU, a+iU)). 


14.2. Summation of series by residues 


The theorem of residues 12.5 can often be used to sum series. To 
illustrate the method we shall prove that 


° 1 = 7 
nezo(z—n)* sin? 72’ 
where z is any number not an integer. 
The gist of the method is that the function 7 cot 7¢ has at each 
_ integer value of ¢ a simple pole with residue 1. Therefore the desired 
sum is equal to the sum of the residues of the function of € 


at its poles other than the pole ¢ = z. 
Integrate f(¢) round the boundary @C,, of the square C,, with 
corners at (n+4)(+1+i). We shall prove in a moment that, as 


n>, f S(8)d&—>0; assume that this has been done. Then, 
Cn 


putting ¢ = z+, we have 


mcotmz 7 cosec? 7z 


KER) i aa mm AC) 
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where ¢(«) is regular at « = 0. So the residue of f(f) at € = z is 
—7 cosec? 7z. The sum of the residues at ¢ = n for all integers and 
¢ = z being zero, we have the required sum. 
(What this argument proves is that the principal value 
fi x 1 7 
= ncty(z—n) sin? zz" 


c) at | 

But, since the sums } and > separately converge, the principal value 
0 -~ 

is otiose.) 


It has still to be proved that f F(6) dg +0. 
aCn 


By a short calculation, 
cosh 2y+cos 2x 


j 1 i A atratncnafers' 
leat G-iy) | cosh 2y—cos 2x" 


On the vertical sides of aC, if 7€ = x+iy, then cos 2x = —1 and 
so |cot 7é| < 1. On the horizontal sides sup |cot 7{| tends to 1 as 
n-> and so |cot 7| < 2 (say). The length of @C,, is 4(2n+1) and 


therefore | on 
dt| < —————., 4(2n + 1). 
,.f0 g| (n+4—-|z|)? ere) 
This is a close estimate, but an O-argument would suffice. | 


The reader would find it interesting to prove directly 


C) 1 7m 
= (z—n) sin? 7z 
by showing that the difference between the left- and right-hand sides 
(i) is regular except at the values z = n, 
(ii) is bounded as z > n, 
(iii) has period 1, 
(iv) tends to 0 as y > 00, uniformly for —4 < x < 4, 
and then applying Liouville’s theorem 12.22. 


14.3. Partial fractions of cot z 


A polynomial p(z) having n zeros can be written as the product of 
factors 
A [I (z-a,). 
1 


Also a rational function g(z)/p(z) is expressible in partial fractions 
with the factors of p(z) as denominators. 
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A vital problem of complex function theory is the resolution of a 
regular function which has infinitely many zeros into the product of 
infinitely many factors. There is the associated problem of writing a 
meromorphic function in partial fractions, displaying its poles (in 
general a countable set). Questions of convergence will arise. Trigo- 
nometric functions provide good illustrations of these problems and 
we shall prove the formulae 


2 C3 Za 
sin 7z = 7z I (1-3), 


where the dash after the = means that the term for n = 0 (which is 
undefined) is to be omitted. 

The latter formula will be proved directly. Infinite products have 
not yet been discussed and an investigation including the sine product 
as a particular case will follow in §14.4 and §14.5. 

The series summed in §14.2 may be written 

mm 1 Sy. 
“Sint ae * @ = 7 aye 
We shall integrate this equation along a path y in the ¢-plane from 
0 to z which avoids the points +1, +2,.... At € = 0 the left-hand 
side, ¢ say, is regular (or the singularity is removable). On the right- 
hand side the mth term is O(1/n®) and the series converges uniformly 
on the path of integration. 

The function (£) = 7 cot 7§—(1/€), if (0) is defined to be 0, is 

regular at € = O and ©'(£) = 4(f) (¢ + +1, +2,...). Therefore 


i Ode = [oo] - o@ 


and we have proved that 


The right-hand side has nth term O(1/n®) and converges absolutely. 
If we wish we may remove negative indices by combining the 
terms for +m and —n, 


Le az 
m cot mz = 7+ Zo 


but the expression in first-degree partial fractions is more illuminating. 
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There is a oe formula for the cosecant 


opt eo (A+). 


sin7z Zz z—n nit 


Exercises 14(4) 
Obtain the expansions in 1-3, 


pan CI OtD 


1. sec "24 nt d)int— 22" 
1 
2. tanz = 2% a Gibco 
i ire Zz 4 pt lal 
3. — BET +5 = Fcoth 5 = = 14+2z' = Autor 


Carry out the summations in 4-7. Observe that, in many such questions, the 
methods of chapter 9 (particularly §9.8) provide alternatives to those of §14.2. 


a 3 Las 1_7(1+¥3 sinh 47/3) 
T 64n'—-1 2 12 cosh 47/3 
Es » oe a) = i oni iC): 
6. > amctEt +p coth (" / 4) (a> 0,6 > 0). 
1. Ec- pina ed (<1 <a<m,x#n). 


Exercises 8, 9 refer to Bernoulli numbers which figure in a number of formulae 
in analysis (e.g., in theorem 14.86). 
8. The Bernoulli numbers B,, are definied by 
Zz Zz 


z zm 
~ anata ta 2am B 


2a 
ny 


Prove that 

(i) this series has radius of convergence 27; 
(ii) By = 1, B, = Oif nis odd; 

(iii) the sequence of B,, satisfies 


Ly se 2n+1\ _ : 
Sra. ( i )- 2n+1; 
(iv) B, = 4, By = —3'5, Be = tz, Bs = —355- 
2(2k)! Sox 
Casa 


9. Use 3 to prove that 


By = (-1)4 


where sa, = >) ~~ and that, for large k, 
1 
2(2k)! 


|Bax| a Qn" 
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14.4 Infinite products 


The statement in § 14.3 of the factors of sin 7z was the first mention 
in this book of an infinite product. We must lay down the necessary 
definitions and prove theorems about convergence or divergence. This 
can be done briefly since no new principle is involved and infinite 
products are closely linked with infinite series. 

Write 6 

A, = Ju (1+a,). 


Definition. If, as n tends to infinity, A,, tends to a limit A, not 0, we 


say that the product \{ (1+a,) converges and has the value A. 
r=1 


Definition. Suppose that 1+a, = 0 for at least one r < mand for 


© 
nor > m. Then the product [J (1 +4,) is said to converge to zero if and 
r=1 


co 
only if J] (1+4,) converges to a non-zero limit. 


r=m 
o 
Definition. If [| (1+4a,) comes under neither of the last two definitions, 
r=1 


it is said to diverge. 
It pays to describe as divergent a product for which A, tends to 0, 


for instance (:-!) (1-1) (\-!) 
2 3°” i) i 
n 


: 2 rs a u The reason, which will become plain 
eee n n 

in the theorems that follow, is that the behaviour of the product 
II (1 +a,) is linked with that of the series Za,,. 


where A, = 


Lemma. Inequalities between products and sums, Let a, > 0 and 
Sy = A+... +dy. Then 


(1) [1 d+, > 1+5,. 
i 
If, further, a, < \forl <r <n, 
(2) Tl (1-a,) > 1-5, 
1 


1 
1l+s,/ 


@) 10-4) < 


14.4] INFINITE PRODUCTS 429 
If, further, s, < 1, 


@ Id+a) < 72 


1=3, 


Proof. Induction gives (1) and (2). To deduce (3) and (4) use 
(1+a)(1-a) < 1. | 


Theorem. 14.41. (1) If a, > 0, then I (1+a,) and Za, both converge 
or both diverge. 

(2) If 0 < a, < 1, then Il (1—a,) and Za, both converge or both 
diverge. 


Proof. Use the appropriate inequality from the lemma. For - 
instance, in (1) suppose Za, convergent. 
Choose m such that 


t= Ami t@migt..< 1 
By (4) of the lemma, 
(1+@mi1) «+» (1+a,) < 1/1-2. 


The left-hand side is a bounded increasing function of n. Hence the 
product converges. | 


Theorem 14.42. If a, > 0, then Tl (1+a,) is independent of the order 
of the factors. So is 11 (1—a,) if0 < a, < 1. 


Proof. Use monotonic sequences as for the corresponding result 
for series (e.g. C1, 94). | 


Theorem 14.43. A necessary condition that Il (1+a,) converges is 
that a, >O0asn—>o, 


Proof. 1+a, = A,/A,-1 and A,-1, A, both tend to A (not zero). | 


Definition. (Absolute convergence.) The product Il (1+4a,) is said to 
converge absolutely if II (1+ |a,|) converges. 


Theorem 14.44, If Tl (1+a,) is absolutely convergent, then (1) it is 
convergent and (2) its value is independent of the order of its factors. 


Proof. Write |a,| = bn, An = IL (1+a,), By = I (1+8,). 
1 1 
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Then 


Ave —1| =m betas Tl 
K(ltbdedsee =! 
= Pa 4, 
2 


Also |A,| < B,. Multiplying the two inequalities we have 
|Antp—Aanl < Brip— Bn 

By hypothesis the B,, form a Cauchy sequence. Hence so do the A, 
and (1) is proved. 

Let A, > A and B, > B. 

Let II (1+<a;) be a rearrangement of II (1+a,) and II (1+5,) the 
same rearrangement of II (1+5,). Let A,, and B,, be the respective 
products of the first n factors. By theorem 14.42, B’ = lim By, = B. 

Given n, take q so large that Aj contains all the factors in A,, (and 
so Bi those in B,). 


Then, if r > q, 
|A,—A,| —-B,, (by the proof of (1)) 


< B 
<Biavy= BoB 
and so 
|A—Aj| < |A—A,|+]|4n—4;| < |A—A,|+|B-B,l. 
Therefore 4; > A. | 


In what follows we shall connect the logarithm of a product of 
factors (assumed not zero) with the series of logarithms of the 
separate factors. This is an easy exercise if the factors are real, but 
more delicate if they are complex. Each logarithm will be supposed 
to have its principal value. 


Theorem 14.45. Il (1+a,) converges if and only if, for some m, 
1 
> log (1+4@,) converges. 
m+1 
Proof. If ¥ log (1+a,) converges, to sum /,, say, then (since the 
m+1 


exponential function is continuous) [] (1+4,) converges to exp /,,, 
m+1 


and TI (1+a,) = (144,) ... (1-+ay,) exD Ip 
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The converse needs more care because, with principal values, 
log zw need not be equal to log z+log w but may differ from it by 
2ni. However log zw = log z+log wif |phz| < 47 and |phw| < 47. 

Suppose that II (1+a,.) converges, 

Then, given e(< 1), there exists V such that 


TE C+a)=1] = [Amen diAnal <@ 440 


for alln > N and all p > 0. 
If |z—1| < € < 1, then (as is clear from a diagram) 


l-e < |z| < 1+, (14.42) 

and |phz| < arcsine < 47¢ < 47. (14.43) 
n+p n+p 

Noweither log II (1+a,) = & log(1+a,) (14.44) 
n nm 


or the two sides differ by a multiple of 277. We prove equality for 


n> Nand p > 0. 
Let n > N. Then (14.44) holds if p = 0. Suppose that it holds for 
p= q = O. By (14.41) and (14.43), 


[ph i +9) < 4m, |ph(1+ansqus)| < 40 


Wl 


nt+a+1 n+a 
Hence log J] (1+4,) = log II (1+4,)+log(1+4n+g+) 
n n 


n+q+1 
dS log(1+a,). 
n 


Thus, by induction, (14.44) holds for all p > 0. 
Finally, (14.41)-(14.44) show that, for fixed m, the function of n 


defined by y log (1 +a,) is a Cauchy sequence. | 
m 


Theorem 14.46. If, for a fixed positive integer k, &|\a,|*+* converges, 
then T{(1+a,) exp (—ay, +4a2-... + (—1)*ah/} converges 
absolutely. 

Proof. The nth factor is 

exp {log (1 +a,) — ay, +4a2—...+(—l)*ahi/k} 
exp {O(|an|***)} 
1+O(\a,|**) 
= 1+b,, 

where = |b,,| converges. | 
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Theorem 14.47. If Zap, Zaz, ... Zak and = |a,|* converge, then 
TI (1+a,) converges. 
Proof. As in the last theorem, 
log (1+z) = z—4z?+...+(—1)*1z#/k + O(|z|*4). 


In this write z = a, dg, ... dn, ... and sum. The hypothesis shows 
that = log (1 +a,) converges. Apply theorem 14.45. | 


The reader should be able to define uniformity of convergence of 
products II {1 +-/,,(z)} and to prove theorems which naturally arise, 
such as the analogue of the M-test (theorem 5.32), 


14,5, The factor theorem of Weierstrass. The sine product 


Theorem 14.51. Given a sequence of complex numbers ay, day «++ 
whose only limit point is 00, there is an entire function with zeros for 
these values of z and no others. (a, is repeated k times if the zero there 
has order k.) 


Proof. Assume for the present that no a, is 0. 
We may suppose that 


|a,| < |a| < |ag|..., with |a,| > 00. 
If the product II (1 -2) 
1 ne 


were convergent, it would define the entire function sought. In 
general the product does not converge and we have to affix convergence 
factors.to the factors of the product in the manner of theorem 14.46. 
For shortness write E(u, 0) = 1—u, and 


E(u, p) = (1—u) exp (u+4u?+...+u?/p). 

It is always possible to find a sequence p, to make = |z/a,|?a+? 
converge for all values of z. In fact p, = n would do because, given 
z, if n is large enough, |a,| > 2|z| and |z/a,|" < 1/2”. 

The argument of theorem 14.46 proves that, for a fixed R, there is 
a constant A such that 

|E(Z/4ny Pn)—1| < A|z/aq|?=*, 
for |z|<R and all n. 


Then f(z) = Ut E(z/a,; P,) converges for all z, and the convergence 
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is uniform for |z| < R, however large R is. Theorem 13.11, shows 
that f(z) is an entire function. It has zeros at a, and nowhere else. 

At the beginning of the proof we ruled out the possibility a, = 0. 
If the function is to have a zero of order k for z = 0, then we adjoin 
a factor z*. | 


Notes. (1) The choice p, =n is extravagantly large. In many 
common applications p,, can be taken to be a suitable constant (often 
1 or 2). 

(2) If f and f, both satisfy the requirements of the theorem, then 
Alf, having removable singularities at the common zeros of f and f,, 
is an entire function, say g, without zeros. The function g must be 
of the form exp h(z), where A(z) is an entire function. For g'(z)/g(z), 
being entire, is the derivative of an entire function h(z). Then 


4 (g(2) exp (—M2))} = exp (—h2)){e"()-a(@)M(@)} = 0 
and hence g(z) is A exp A(z). 
Theorem 14.52. sin nz = nz a (i -7). 
Proof. In theorem 14.51, a, = +n, and = (1/n?+) converges if 


p = 1. So we have 


sin mz = g(z)mz ny (1 -) exp ‘|, 


where the dash in I’ (or in 3) denotes that the term with n = 0 is 


omitted. Here g(z) is an entire function without zeros, to be found. 


Writing Sy(z) = g(z)mz I ((i -?) exp ‘|, 


; g'(2) y (4 ‘)| 
we have Sy(z) = (E+ +542 (+5) | vO 
where z is not an integer. 

The proof of theorem 14.51 shows that sy(z) converges uniformly 
to sin 7z on any compact set. From theorem 13.11, sy(z) converges 
to m cos 7z, Therefore 

#01, 2 ae of 
ree mats) Pee ee ea 
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Collating this with the formula for cot 7z found in §14.3, we 
deduce that g’(z) = 0, and so g(z) is a constant A. As z+0, 
sin 7z ~ mz and therefore A = 1. 

Multiplying the factors containing +m and ~—n, we have the 
result. | 


Exercises 14(c) 
Examine for convergence the products whose nth factors are given in 1-6, 


sin (z/n) 
1 andy 
zi/n 
atn 


2. ret 


3. cosh, 
n 


4, 1+(-1)" sinh =. 
+z" 
1+z™" ° 


7. Prove that II (1 + ) diverges and IT ji+é converges. 


8. Prove that, if |z| < 1, the infinite product 


(1+2z)1 +21 +24)(1+2%)... 
converges to 1/(1—z). 


9. Prove that, if |z| < 1, the product of the three infinite products 


iia +2), ita +281), iia - 21) 
is 1. 
10. Prove that, if |z| < 1, 
Fi! on 
=z 20-2) 30-25) | 


11. Express cos 7z in factors, on the model of theorem 14,52, 


ila+2) = exp iS 


12. Prove or retits the following statements for real a, by. 
@ If lim it (1+a,) = 1, then ita +,) converges. 


nor=n 


(ii) If lim (@,/b,) = 1.and i (1+4,) converges, then Tra +n) converges. 
no 1 


co n 
(iii) If Sa, converges, then [J (1+<,) tends to a finite limit as n > 00, 
1 rel 
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13. Prove that, if p runs through the sequence of prime numbers 2, 3, 5, 7, 11, ... 
and rez > 1, then 
- 1 1 5 ‘ = 

@ I (1 3) i’ where the Riemann zeta function ¢(z) ae 
and the zth powers have their principal values. 

Prove further that 

Gi) &(z) is never 0 for x > 1; 

ii) z (1/p) diverges. 


14. Suppose that a, > 0. Given a sequence b,, construct an entire function f 
such that f(a,) = bn. 


15. Elliptic functions. In §14.2-14.5 we have used trigonometric functions 
(periodic functions) to illustrate the text. The methods and theorems can be 
applied to construct functions which possess two independent periods and to 
develop their properties. 

Let «, @, be numbers such that ph(w,/o,) + 0. Write Qn, = 2mw,+2nw, 
where m, n can be any integers (+, — or 0). Let 2’ and Il’ denote a sum and a 
product over every pair of integers m, n except m = n = 0. From exercise 4(g), 11, 
2/Q;5, converges absolutely. 


(i) Prove that 
ot = 201 {(1-35) #0 (G+) 


is an entire function with a simple zero at each point Qm, n. 
(ii) Prove that oz) _ ve 1 aes 
oz) Zz Z—O nn Qnn en 
is regular except for a simple pole at each point ©,,,,. The function o/c is called 
¢, but it has nothing to do with the zeta function of Riemann in 13. 
(iii) Prove that the function (0, defined by 


oe) =-0@) = 443 {3 -5- 


is regular except for a double pole at each point Qn, n. 
In (iv) we shall outline the steps of a proof that 


PEt20) = (2) 
and (z+ 20) = (2), 


that is to say, the function 0 is doubly periodic, having 20, and 2w, as periods. 
We observe that a doubly periodic function which is regular for all finite z is 
bounded and therefore, by Liouville’s theorem, a constant. For historical 
reasons, a doubly periodic : function which is meromorphic in Z is called an 


clips fanclo 
iv) Prove that (if z + Qn,n) 

(a) @ is an even function, 

(6) its derivative 90’ is odd, 

(c) @’ is an elliptic function, 

(d) @ is an elliptic function. 

Elliptic functions have a multitude of properties; the prevailing method of 

proof is by Liouville’s theorem. As one illustration we ask the reader in (v) to 
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construct the differential equation for (0(z). For anything more we must refer him 
to books cont: tematic accounts. ~~ . 
(v) The differential equation for (2(z). 
Establish the Laurent expansion 


Q(z) = 2+ ayz*+a,24+ O((z|*), 
with constant term 0, in a disc centre z = 0, Choose coefficients g,, g3 so that 
{Q’@)}? = 4{(z)}*—82§(z)— g5+ O(|z|*) 
and deduce the differential equation. 


14.6. The gamma function 


The gamma function I'(1 +z) extends the factorial n! to any z, real 
or complex. We acknowledge that Jeffreys and Jeffreys are right in 
contending that the name ‘factorial’ and the symbol *!’ ought to 
have been used for the extension and that a new notation was otiose. 
But we lack the courage of their convictions and continue the usage 
established by Euler and Legendre. 

Three definitions are possible, all of which are useful: 


Buln) Tes = ie peti (ese es =i) 
0 
where f* means exp (z log 1), the principal value; 
Le 


nin 
G (Gauss) I(1+z) = lim @41)@+2).0@4n)’ 


where z is not a negative integer and n* has its principal value; and, 
thirdly, a definition of the reciprocal as a product of the type given 
in theorem 14.46, 


W (Weierstrass) ESS = e* I, {(1 +2) c=, 


where y is Euler’s constant (namely lim (5 (1/r)— log n}) . 
. 1 


It is easy to reconcile the second and third definitions G and W. 
The right-hand side of W is 


lim few (1+3+- oe log n)| Il fe e* 
Pa ies 


n> eet 


= lim 72@+)-. Gta) 


no n! s! 


which is 1/I'(1+2z) according to the definition G. 
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Observe that theorem 13.13 shows that Euler’s integral defines 
T(1+z) as a regular function for rez > —1. By theorem 14.51, W 
defines 1/I'(1 +z) as a regular function for all z with simple zeros at 
z = —n. So I(1+z) is meromorphic, regular except for simple poles 
at z = —n. Thus G and W will give the analytic continuation of the 
function defined by E into the whole plane Z with the negative 
integers removed. 

We have still to reconcile the Euler and Gauss definitions. Since 
they both define regular functions in their domains of existence it is 
sufficient to prove equality for some interval on the real axis, say 
0 < x < 1. Byn integrations by parts, we find that 


Le ae n=+1 n! 
[re (1-f) dt = GaDet+d «. Fat) 
and the right-hand side is the Gauss expression multiplied by the 


factor n/(x-+n-+ 1) which has limit 1. So what we need to prove is the 
following theorem about the limit of an integral. 


Theorem 14.61. If 0 < x < 1, then 

ope 1\" co 

lim (1-) dt -{ edt. 
0 n 


no 0 


Proof. We show first that, for a fixed positive ¢, 


(-t) 
n 
increases with n. 
In the straightfoward inequality (C1, 17, exercise 1 (d), 8) 
SS ant ie 1 -—a" 


Sa O<a< 1) 


substitute a” = a, We have then 
n+l 


t 
1-7 <a") O<t<n) 


t\” t ntl 
and hence (1 - ‘) < (1 = i) ‘i 
n n+l 


We know (exercise 5(c), 13 or C1, 109, exercise 6(a), 3) that 


lim (1-7)" = et, 
no Nn, 
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Given e¢, choose m such that 
if tetdt < 
m 


In [0, m] the increasing sequence of continuous functions 


m(1-f)" 


has the continuous limit fe-. 
By theorem 5.35 this convergence is uniform and by theorem 5.22 
we can choose my > m such that, ifm > Mo, 


m m t n 
o<f retdt—{ e(1- ) dt <e. 
0 0 n, 


Hence, for n > 1, 


a fetdt—2e < fre (1-£)"ae 
} 0 n 
< [*(1-f)"a 
0 n, 
< fe te-tdt. | 
0 


In proving properties of the gamma function we can use whichever 
definition best serves the immediate purpose. The following results 
are basic: 

(1) Td+z) = 2zT(z), Td) =1, T@+l) =a!. 

(Prove from either E or G.) 

7 

2) T@rd—-z) = ans" 

TQ) = yn. 


Proof. Multiplying the two W products we have 


ravara=a~ Ai(-4) 
(l+2Td-2z) nail 


1 _ sin 7z 
z2(zT—-z) =z 


For the value z = $ note that I'(4) is not negative. 
(3) The duplication formula 


T(@)T(2+4) = wi2!-#T (22), 


and so (from theorem 14.52). 
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Proof. From G, the left-hand side is 


} nn! i n-tn! 
eel) GSI GED Ea es GED) 
‘ n™*-4(n!)222" 
= lim 


(2z)(2z + 1)(2z+2) ... (2z+2n—-1)° 
From the Gauss formula for I'(2z) with 2n in place of n we find 


‘ (2n)*-(2n)! 
Ti(22)-= lim yy (Ge 1)(22-+2) «(2-20 1)" 
Hence T(z) l(z+4) = A2?-“T(2z), 
where A= ii CD aes 


Qeaienint” 


The value of this limit is probably known to the reader (A = ./7, 
Wallis’s formula for 7, e.g. C1, 135); without assuming this know- 
ledge we have only to put z = 1 in the preceding line, obtaining 
T(3) = 4AI(2) and so A = T'(4). 

(4) The duplication formula (due to Legendre) is the most useful 
case of the general multiplication formula (due to Gauss) 


T(r (-+i) ove (-+7=1) = (27)t—Ypt-"-T (nz), 
This may be proved by the same method. 
(5) As an application of gamma functions we use them to evaluate 
the infinite product Il u(n) where u(n) is a rational function of n. 
n=1 


If the product is to converge, the degree inn of the numerator of 
u(n) must be the same as the degree of the denominator. The method 
will be clear if we take the degree to be 2 and express, in terms of 
gamma functions, the product 


pee tl (n—a,)(n—as) 


~ net (1 b,)(n—b,)’ 


where no a or b is a positive integer. 
The nth factor of P is 


jee g(t) 
n nN 
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Hence a necessary and sufficient condition that the product P 


converges is that , +4, = by +b. 


The nth factor can then be written 


( te 41) euln (1 E: as) euln 
n n 

(iP )onm (1B) one 
n n 


The W definition shows that 


p= Lab) T( — 5s) 
~ Td-a)0Q—a,)’ 


Exercises 14(d) 
Find the values of the infinite products whose nth factors are given in 1, 2. 


1. 1—n* (n 22) fork =1, 2, 3,4. 
2. 1+n* (n2>=1) fork = 1, 2,3, 
3. Prove that 


il peels Stn 
fi+cal repre &> 
4. Prove that [+ iy)|? = zy/sinh my, 


|[G+ iy)|? = 2/cosh my. 
| Gy)|* = 7/y sinh my. 
5. Prove that 
a-a(145) ('-3) ( i”) he es 
What is the value of the product if the factors are rearranged so that two with 
a — precede each factor with a + ? 
6. Find the residues of I'(1 +z) at its poles, 


14.7. Integrals expressed in gamma functions 


Many common definite integrals can be evaluated by gamma 
functions. 
Define the beta function by the equation 


Z 
Btp, @) = [x4 —3ye-4ds, 


the integral existing if rep > 0, req > 0. 
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The following properties (i) to (iv) are elementary. 
(i) B(p, q) = Bq, p). 

(ii) pB(p, q+ 1) = gB(p +1, 9). 

(iii) B(p, q) = B(p +1, q)+ B(p, q+ 1). 

(iv) pB(p, 9) = (p+) B(p +1, 9). 


Theorem 14.71, B(p, gq) = Fano). 


Proof. In order to avoid unbounded integrands we shall suppose 
that re p > 1 and req > 1. The property (iv) above will then extend 
the theorem to any p, q with positive real part. 


T(p)T(@) = i S etx? I : evyt-ldy 


A A 
lim dx i ett) xp—lya—1 dy 
i} 0 


A> 


= lim ff e-@tv)xP-lya-l dx dy, 
S(A) 


Ao 


where S(A) is the square with opposite vertices (0, 0), (A, A). The 
line joining the points (A, 0) and (0, A) divides the square of integra- 
tion into two triangles, the south-west one A(A) having its third vertex 
at (0,0). In A(A) make the transformation x = u, y = v—u (for 


which 0(x, y)/@(u, v) = 1) and i becomes an integral over 
A(A) 


0 <u<v <A. Expressed as a repeated integral it is 
A v 
I dof e~uP-\(v — uu)? du. 
0 0 
The substitution u = vt in the inner integral gives 
A 1 A 
f do { ent +a-1pp-1] — t)-1 dt = Bip, of e-*pP+4-1 dy, 
0 0 0 
If p and q are real (which is the usual case) it is simplest to use the 


i) A <ff . {J A 
S(t) A(A) S(4) 


since S(44) < A(A) < S(A) and the integrand is positive. 
As A -> 00, each of the integrals over the squares tends to I(p) T'(q), 
and the integral over the triangle to B(p, q) (p+). 
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If p and g are not real, we cannot assert the preceding inequalities, 
but we shall prove instead that the integral over the north-east 
triangle (A, 0), (A, A), (0, A) tends to 0 as A > 00. 
If p, and q, are the real parts of p and q, the integrand has modulus 
at most e~4x?:-lym-! and the integral has modulus at most 
e~44”1+%/p,q;. This tends to 0 as A > « and the theorem is proved. | 


To illustrate theorem 14.71 we add an alternative proof of the 
duplication formula (§14.6, (3)). 
We have, x being real and positive, 


or * f : fH — 14d, 


Put t = 4(1+u). The right-hand side is 
1 ‘1 
Ph (1+u)*-\(1 -—u)*"du = 22-* i| (1—w*)* du. 
-1 0 
Now put u? = v and we have 


Qi if d —v)“y-tdy = 2-®B(x, 4) 


_ re FOOTY) 
T(x+4)° 


This proves the formula for positive x. The left and right sides of 
§14.6 (3) are regular throughout the z-plane except at their poles. 
Theorem 12.13 shows their equality. | 


Theorem 14.72 illustrates the expression of a multiple integral in 
gamma functions. 


Theorem 14.72. (Dirichlet’s integral.) 


where p, q, r, S are greater than 0, and A is the tetrahedron bounded by 
the planes x = 0,y = 0,z = 0,x+y+z = 1. 


Proof. In order to have a continuous integrand we prove the 
result when p, q, r,s are greater than or equal to 1. The extension 
to values between 0 and 1 would require a discussion of multiple 
integrals of unbounded functions. 
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The neatest method is to write 
xty+z=& ytrz=&, z= ng, 
so that x= &1-7), y = &(1—$). 


The x, y, z tetrahedron is then seen to be mapped onto the cube in 
which each of £, 7, ¢ is between 0 and 1. ‘ 

The Jacobian @(x, y, z)/A(E, 9, ¢) is £3. 

The integral then becomes 


‘1 rT 1 
fae [oan [erie — pagers npg — a6, 
0 0 0 


which is the product of three single integrals in &, 7, ¢ 
Apply theorem 14.71 to their product 


B(p+q+r, 8) Bq+r, p) Br, q). | 


Exercises 14(e) 
1. Ifa > 0,5 > 0,k > O, express in I’ functions 


1 
my ih x-o, 


1 d+x)"=d- +x)*-1(1 — x21 
Gi) i, a +x? 


2. Express in terms of T(4) 


eit. ..do 
© | Garay 


(ii) if (53) a 


3. Prove that, if0 < a <1, 


ifs y* cosydy = I'(a) cos 47a, 


j y* sinydy = I(a) sin 47a. 


4, Express the content of the unit ball in R" as 

mn/T(Gn+1) 
and show that this is the value obtained in exercise 8(f), 12. 
5. Prove that, ifb > a> —1, 


4 mY (a+1) 
2°11 (4a+4b+1)TGa—-4b+1)° 


Pius 
[ cos* 6 cos b6d0 = 
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6. Prove that, if rez > 1 and &(z) = }n-, 
T 


oO ped 
f =— at = &z)T(z). 


e-1 


14.8. Asymptotic formulae 


The object of this section is to develop methods of approximating 
to I'(1 +z) for large |z| by formulae suited to numerical computation. 
Stirling’s formula for the factorial 


n! ~ 4(2m)n"+te-m 


is likely to be already familiar to the reader. (A proof is outlined in 
C1, 148.) Our first theorem is a refinement of the formula. 


Theorem 14.81. If n is a large positive integer, 
1 1 
= n+ e~ aos 
A(2m)n"*4e-” f +7,+0(A)}- 


Proof. The argument is elementary and we state it without 
comment. 


fr es xdx—4{log (n—1)+log n} 
= nlogn—(n—1) log (n—1)—1—$ log (n—1)—4 logn 
=(n—4) log (1-4)-1 


ofl saeo( $= 


1 
= iat (Ss 3): 


Summing from 2 to n, we have 


nm n af n 1 1 
[Ptoe xdx— 3 tog r+41ogn = Dypt 4+0(5) 


where A, here and in the following lines, is a constant. It is not 
necessary to put suffixes A,, Ao, ... to denote that the constants in 
successive steps may differ. 

The last equation is 


(n+4) log n—n—log (n!) = 4-4 D> ato(4). 
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Since eet 
(+Dr P < Wr—1)’ 
1 oa 1 
we have aa < A ti 
and hence z IL = 1+0(4). 
nil n n 


Thus we have proved that 
log (n!) = (n+4) log n— ntAtoe +0(x) 

1 1 

ero ntte-n ae oe 
and therefore n! = An"*#e~" exp (5+ (3s)| 

1 

= Anttte-n 

An"tte +a +0(Js )}- 


To find this unknown constant A we substitute the formula we have 
just obtained in Wallis’s formula (C1, 134) 


(n!)?2%" !? Ee 
oat 
and we obtain A = (277). (Compare the evaluation of the constant 
in the duplication formula §14.6 (3).) | 


We take up now the more difficult problem of approximating to 
T'(1 +z) when the complex number z has large modulus. On account 
of the poles at negative integer values of z, the approximate formula 
must be restricted to a sector 


—m+é < phz < 7-8. 


We shall ultimately prove that the formula to be stated as theorem 
14.86 holds in the smaller sector 


—41+6 < phz < 47-0. 


The approximation will take the form of an asymptotic expansion 
(or series) according to Poincaré (1854-1912). The formal definition 
will be easier to grasp in the light of a simple illustration. 


Example. Prove that, for positive x, the function f defined by 


foo) = [ade 
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vais A) = 5,(2) +r), 

where Sn(X) = 124 —...+(- pd! 
2n)! 

ie Ire] < GO. 


Hence approximate to f(x) for large x. 
Solution. Substitute 


pn 
oa eae — ])n-1pan-2.4. (1) n 
= 1-f+...4+(-1)* "4 +( 1" A 


1+# 
in the integral defining f, We have the required s,, and also the 
inequality 
'g-wtyan (2n)! 


Irn(x)| ad i, 1+2 dt< i} emtindt = xinti* 
The remarkable property of the decomposition 
S(%) = Spl) +7n(%) 
is that, as n-> oo, the sequence s,(x) diverges for every x. The 
remainder r,,(x) is, however, of the order of magnitude of the (n+ 1)th 
term of the expansion (in this example, numerically less than it). If 


x is large, the terms of s,(x) initially decrease in magnitude and the 
value of f(x) can be computed with high accuracy by stopping at the 


if 
Car with smallest value. 


We now define formally an asymptotic expansion (or series), and 
in theorems 14.82 and 14.83 we establish properties that we shall need. 


term 


Definition. Let s,(z) be the sum of the first (n+ 1) terms of the series 
ai Gn, 
ee a (14.81) 


Let r,(z) = f(z)—s,(z). Then the series (14.81) is called an asymptotic 
expansion of f(z) for a < Phz < P if, for each fixed n, 
lim z"r,(z) = 0, uniformly in Phz. 
lel|o0 
This definition applies to a power series in 1/z which converges 
for sufficiently large |z|, say for |z| > R. For then there is a constant 
M, depending on R only, such that for all values of Phz 


j MR 
irn()| < -BE*" 
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The notation f(z) ~ ¥ a,,2~” is commonly used for an asymptotic 
0 
expansion. As the symbol ~ has been given a different meaning in 
§4.1, we shall refrain from using it now. 


Theorem 14.82. (Uniqueness.) (a) For a given interval of Phz a 
function cannot have more than one asymptotic expansion. 

(b) A series can be the asymptotic expansion of more than one 
function. 


Proof. (a) Suppose that, for « < Phz < f, Za,z" and =b,z 
are both asymptotic expansions of f(z). Then, for fixed n, as |z| > 00, 


(ay—by) 2" +(@,—by) 2" 1+ -. +(dy—by) > 9. 
It follows that ay = bo, a; = Dy, «+. An = bp (for every 7). 
(b) The reader can verify that an asymptotic expansion of f(z) for 
—|n < phz < 4ris also an asymptotic expansion of f(z)+e~*. | 
Theorem 14.83. (Integration term by term.) Jf, for « < Phz < f, 


aq Gn 
Gotten t inte 


is the asymptotic expansion of a regular function So(zZ), then 


is the asymptotic expansion of | fe) ao~ | de, where y is a 
Y 


suitable path from z to «0 within the sector « < Phz < B. 


Proof. Write S(@) = folz)-ao- a 
and 52) = B+. +S, fle) = Sule) +ra(2). 


From the definition of an asymptotic expansion, given e, there is 
Z, such that 
[f(@)—s,(2| < elz| for |z| > |zol, « < Phz< A 


Let 0 be fixed ina < 0 < f. Let 7, be the linear segment ¢ = pe” 
from z to 2’ where r = |z| > |zo|- 
Let y be the infinite extension of y;, when 7’ = |z’| > 00. 
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For € ony, 


S()—Sn(S) = O(|E|-"), where n > 2, 
and 5,() = O(|£|-*). 
Therefore i {f(O-s (Ode and i 5,(€)d€ exist, and hence 
ms Y 
J J(©)d€ also exists. Moreover 
a 


€ 


[J Mo-ssorae| < of” B= So. 
This is the condition for 


as eee e 
ztet@opmt 


to be the asymptotic expansion of J S()dé. | 
A 


We need a number of properties of the gamma function. 


rM+z) 
T(1+z)’ 


Theorem .+./4. If F@i= 


where z is not a negative integer, then 


() Aa) = -7+E(7-—E), 


mn 27, 


1 


QQ = Lape 


ete 
GC) #'@) = {fF ea dt (rez > —1). 


Proof. (1) In the W definition of 1/I'(1+z) the infinite product 
converges uniformly on any compact set not containing any of the 
points —1, —2,... (by the analogue of the M-test, since the factors 
are 1+O(1/n*)). Writing 

S,(Z) = ev? Il (( +3) esl, 
1 r 
we have, by theorem 13.11, 


; M+ ___ AQ) 
“> asap - Td +2) 
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that is, 20 =F). 
But ste) = {+3 (35-7)|5@. 


and we have proved (1). 

(2) We again appeal to theorem 13.11. 

(3) The reader will have observed that the series = (z+n)~ is of 
the type discussed in §14.2. We could find a formula for the sum by 
integrating (z+ {)~* 7 cot mf round a sequence of suitable circuits C,, 
enclosing the points ¢ = 1,2,.... We can however obtain the 
integral in (3) much more simply as follows. By theorems 13.11 and 
13.13 the series and the integral on the right-hand sides of (2) and 
(3) are regular if re z > —1. If we prove them equal for real z (say x), 
then theorem 12.13 shows that they are equal for rez > —1. 

Write f,() = te*#+”, Then f,(t) 2 0 for t > 0, and 


= te~ 
HAG) a a 
Since this sum is continuous, by theorem 5.35 the convergence of 


> f,{t) is uniform in [d, T] for 6 > 0, By theorem 5.22, 
1 


P Bala ${ fn} 


We now see from theorem 6.33 (for T > 00) and its analogue (for 


6 > 0) that ia ss A 1 
te —nt a i. 
I, of (3, $ ) a oy (x+n)* | 


Next we explain a widely applicable method of obtaining asymp- 
totic expansions of functions expressed as definite integrals. 


Theorem 14.85. (Watson’s lemma.) Suppose that for —A, < t < A, 
$0) = Sant, 
and that |f(0)| < Be (b > 0) for ‘ A, where 0 < A < Aj. Then, if 
|phz| < 47-36, = 
F(z) = | e-*t f(t) dt 
0 


a,n! 


« 
has the asymptotic expansion ae Poa 
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We are to prove, in fact, that substitution of the power series for 
f(t) and integration term by term gives an asymptotic expansion for 
F(z). 


Proof. Given N, there exists C such that 


< Ctve” for allt > 0. 


N-1 
f)- E ant 


If we now write 
F(z) 


i 


N-1 fo 
py f, ea, t"dt+ Ry 


N=La nl 
a,n! 
oi x ye +Ry, 


the theorem will be proved when we have shown that Ryz+1 is 
bounded. If z = x+iy, 


co N-1 
IRol = [fe {t0-"E aa 
0 0 
< im etcrNetdt 
0 


CN! 


Gaopra ifx>s. 


Since |phz| < 47-6, we have x > b as soon as |z| > b cosec . 
With that restriction on z, 
CN1\2|N#2 
NH ee Fa 
|Ryz%4| < (a| sin 8-5)" O(1). | 


The same method proves the following extension. Ifa > —1 and 


I@® =" y a,t" for 0 < t < A, (with the same restrictions on | f(t)| 
0 


and |phz| as in the theorem), then F(z) = J e'f(t)dt has the 
0 
asymptotic expansion 
1 2 a,T(#+n+1) 
Zz ~ get J 
We now establish the asymptotic formula for Log I'(1 +z). In it 
the interpretation of the Logarithm is the value arrived at by analytic 
continuation from the real value taken for real positive z. 
The constants B, are the Bernoulli numbers defined in exercises 
14(b). 
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Theorem 14.86. In the sector —41+6 < phz < 47-6 the function 
Log I'(1+z) has the asymptotic expansion 


Sie es 
(z+4) log z—z+4 log ant Qn—1)2n 2" 


Proof. Applying theorem 14.85 to the integral in (3) of theorem 
14.84, we find (noting that By = 1) that the asymptotic expansion of 


F(-his 1 = 2, 


By theorem 14.83, —F(z)+ logz+A +e 
pansion . Be, 


no 2nz2"? 


has the asymptotic ex- 


where A is a constant of integration, to be determined. 

Appealing again to theorem 14.83, we have as the asymptotic 
expansion of 

Log (1 +z)—(z2+4) log z+z—Az—A, 
$ Bin 

= (2n—1)2n 22-1" 

The constants A and A, can be determined from the value found 
for log (n!) in theorem 14.81; we have A = O and A, = } log 2z. | 


the series 


Notes. (1) The result of the theorem remains valid for 
—m+6 < phz < 7-6, 


Our restriction to the smaller sector arises from the corresponding 
limitation in theorem 14.85. 

(2) To determine the multiple of 27i included in Log I'(1+z) we 
should have to identify the branch derived by analytic continuation 
from the principal branch, which is real for positive z. In the calcula- 
tion of (1 +z) there is no difficulty, because any value of Log I'(1 +z) 
will determine it. 
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$14.6. The definition of ! commonly called Gauss’s was in fact given by Euler 
and rediscovered by Gauss. The Weierstrass definition had been used by F. W. 
Newman (1848). 
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$14.8. If we substitute numerical values of the B,,, the asymptotic formula for 
Log I'(1 +z) begins with the terms 


it 1 1 1 i 
(+3) logz—2+4 log 2n-+7>, — 36028" 126028 16807" 11882" “"* 
It is of great use in numerical work. It is often called Stirling’s series, but a more 
accurate description would be de Moivre’s form of Stirling’s series. It is astonish- 
ing that such a formula could have been found and used correctly (for real z) 


as early as 1730. (See Jeffreys and Jeffreys, Mathematical Physics, chapters 
15 and 17.) z ‘ 
fisicios toda 


SOLUTIONS OF EXERCISES 


1(a) 


2. Use theorem 1.11. 
4. (ii) (4U C)—(BU ©) = (A-B) nC’, and 
(A-B)UC = (A-B)NC’ = C= @. 
The opposite implication is obvious. 
5. (i) (AU B)—B = A-B. (ii) (A—B)UB = AUB. 
6. (AU B)—(AN B) = (AU B)n (AN BY = (AU B)n (4 B). 
7. (AAB)AC = (AU BUC) N(AUB UC) N(4’UBUC)N(A’UB’UC) and 
this expression is symmetrical in A, B, C. Hence 
AA(BAC) = (BAQC)AA = (AAB)AC. 
8. (ii) (A UC)A(BU C) = (AAB)N C’ and (AAB)U C = (AAB)NC’ >= C= 2. 
9. AAB = CAD = (AAB)AB = (CAD)AB = A = (BAD)AC 
= AAC = (BAD)A(CAC) = AAC = BAD. 
10. A—B, B—A, AN B are pairwise disjoint and 
A= (A-B)U(ANB), B= (B-A)U(AN B), 
AUB = (A—B)U(B—A)U(AN B). 
Hence |A| = |A—B|+|An Bl, |B] = |B—A|+|An Bl, 
|AuB| = |A—B|+|B—A|+|An BI. 


1(6) 


1. Let {{a}, {a, b}} = {{ch, {c, d}}. If a = b, then {fa}, {a, b}} = {{a}, {a}} = 
{{a}} and so {{c}, {c, d}} has one element only. Thus {c} = {c,d} and so c = d. 
Then {{c}, {c, d}} = {{c}} anda =c. 

If a + b, the above argument shows that ¢ + d. Also {a} = {c} or {a} = {c,d}. 
Since {c, d} has distinct elements, {a} + {c, d}. Hence {a} = {c}, ic. a= c. Then 
{a, b} = {c,d} and so b = d. 


2. (i) xe(AUB)xC<>+x =(y,z), where yeAUB, zeC<xEAxC or 
xe BxC+xe(AxC)u(BxC). 


3. A= B=>AxB= BxA.If A + B, we may suppose that A has an element 
x not in B. If ye B, (x, y)€¢ Ax B, but (x, y) ¢ Bx A. 

Take A = {a}. Then (Ax A)x A = {((a,a),a)}, Ax(Ax A) = {(a, (a, a))}. 
These are different since a + (a, a). 


4. {a}x {a} = {(a, a)}. See 1. 


5. (i) ye f(U A) = 4 x UA such that y = f(x) + ye f(A) for some Ac > 
yeU f(A). 

(ii) ye f(N A) = 4xXENA such that y = f(x) = yef(A) for all AeG => 
yen f(A). 
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If fis injective, y = f(x) for at most one-x € X. Hence y € f(A) for all Ac > 
3 xe A such that y = f(x). 

If f is not injective, there are distinct x, x’ € X such that f(x) = f(x’) = y, 
say. Take A = {x}, B = {x’}. Then f(4n B) = f(2) = 2, f(A) f(B) = 0}. 


6. Proof similar to that of 5 (ii). 


7. Gi) xe f-(N B) = f(x) €NB=+f(x) eB for all BE@ +x ef-(B) for all 
Be@ xe) f-(B). 


9. (i) xe A = fQXE f(A) exEef*(f(A)). 

Gi) »y ef f-(B)) = 3 x € f-(B) such that y = f(x) <> J x such that f(x) eB 
and y = f(x) > yeB. 

If fis injective, then f(x) € f(A) > x € A; hence f-(f(A)) = A. 

If f is not injective, there are distinct x, x’¢A such that f(x) = f(x’) = », 
say. Take A = {x}. Then f-(/(A)) = f“({y}) > {x, x}, so that f-((A))— 
A+ .@. 

If f is surjective, then y¢ B > 3 x such that y = f(x); hence f(f-(B)) = B. 

If f is not surjective, Y—f(X) + 2. Take B = Y—f(X). Then f(f-(B))= 
f(2) = 2. 

10. f; not surjective > f,0 f, not surjective. f, not injective = fof, not in- 
jective. Hence fy is bijective and so are fy 0 (fof) =f, (oho =fy 


11. The argument shows that xRy for some y implies xRx. But xRy need not 
hold for any y. (E.g. X = {x, y}, R = {(, )}) 


1(¢) 
1. By theorem 1.43, D = C—A is countable. By theorem 1.42, A contains a 
countably infinite subset E. Since EU D is countable (theorem 1.45) and infinite, 
Ev D ~ E. Then 
AUC = AUD = (A-E)U(EU D) ~ (A-E)UE=A, 

BNC is countable. Since B is uncountable, so is B—~C = B—(BNC); in 

particular, B—C is infinite. Hence, by first part, 
B-C ~ (B—C)U(BNC) = B. 
2. (i) (0,1) ~ (a, b): let y = a+(b—a)x (x € (0, 1), y € (a, 5)). 

(ii) (0, 1) ~ (a, 0): let y—a=(I/x)-1 (xe(0,1), ye(a,~)). Clearly 
(-—0, a) ~ (—a, 0). (—1,1) ~ (—~, 0): let y = x/(1+ |x|) ee (—%, ©), 
ye(—1,1)). 

(iii) (a, b) ~ (a, bl etc. by 1. 

3. If @ is countably infinite, then it is of the form {Aj, Ay, ...}. An ~ [n—1, 1); 


let f, be a bijection on A,, to [n—1, n). Then f: U A, > [0, ©) given by 
n=1 


F(x) = filx) if x€ A, 
is a bijection. Argument similar when @ is finite. 


4, Let x € Aj. Clearly {x}x A, ~ A, and so {x}x A, is countable. By theorem 


1.45, A, x A, = U ({x}x A.) is countable. Now use induction. 
zed 
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5. If P, is the subset of which consists of the sequences with infinitely many 0's, 
then P, ~ (0, 1). For (pi, ps, ...) € Ao may be associated with the unique binary 
representation 0.p,p2... (not using recurring 1’s) of a real number in (0, 1). 
Also P—P, is countable, since, for each n > 1, there is only a finite number of 
sequences with p; = 1 for i > n. By 1, F ~ (0, 1). 

Define f:72-F as follows. For p = (pi, Pay ---)s 7 = (G1 Ia ++) EF, 
f(p.D = (Pir Ms Ps Yn ---). Then f is bijective and so ¥* ~ FY, This implies 
(0, 1) x (0, 1) ~ (0, 1) and, by 2, 4, x A, ~ R}. Now use induction. 


6. Let S be the set of integers; A the set of all polynomials with integral coeffi- 
cients, A, the set of those of degree n. Since A, ~ S"*1, A, is countable and so 


© 
is A = U A,. Each polynomial equated to 0 has a finite number of roots. 
n=0 


7. 0 <i< 8: In the decimal representation of the members of R; replace 
i+1,...,9 by i, ..., 8 respectively. We get the set of nonary representations of 
the numbers in (0,1). Thus R; ~ (0,1). i= 9: Some decimals of R, have 
recurring 8's; they form a countable set C. Ry—C ~ (0, 1) and so Ry ~ (0, 1). 
8. Let Ey = En {0} and, for & = 1, 2, ..., put 

E, = En(k3,©), E~.= En(-«, —k~). 
Each E, (i + 0) is finite, for otherwise a series of distinct terms of E; could 


© 
be formed and this would diverge. Hence E = U £; is countable. 
-© 
9. (i) Let A = {ay, ..., an}. Let P be the set of all ordered sets (py,..., Pn) of 
0’s and 1’s, 7 has 2" members. With S € 4 associate (p,, ..., Pn) €F defined by 
ei { lifaeS, 
P= Vo ifa¥gS. 

Clearly Za ~ F. 

(ii) Now let F be the set of 5. As in (i), Ya ~ F. 

(iii) Suppose that A ~ 4, ie. that there is a bijectionf: A > %4. Forx€ A, 
put f(x) = S,. Define S* € Ls by 

xeS* ifandonlyif x¢5S,. 162) 
Since S* ¢ Y4, there is ae A such that S* = S,. Then (+) with x = a becomes 
; aeS*=S§, ifandonlyif a¢S, = S*. 

10. For each interval J of the collection .% choose a rational x; € I. The xr 
are distinct. Hence J is similar to a subset of the set of rational numbers and so 
is countable. . 

Suppose fis increasing. If c (not an end point of J) is a discontinuity, put J, = 
(f(c—), f(c+)). When cy < ¢,f(c:+) <f(c2—) and so the J, are disjoint. 
Hence the set of J, (and so of the c) is countable. 


2(@) 
1. (@) No; p(x, —x) = 0. (6) Yes. 


+h 
2. If p(¢, ¥) = 0, then i (@-W) =0 for all x and 0<h <1; thus 
E 


fe-» = 0 for all y. Differentiate w.r.t. y: 6(y)— YG) = 0 for all y. 


456 SOLUTIONS OF EXERCISES 


3. y =x in (ii) gives 2p(x, z) > p(x, x) = 0. z= x in (ii) gives p(x, y) < 
p(y, x); interchange x, y to get p(y, x) < p(x, y). 


4. [Ere Erls ores [Ene —Enl < PCCey x) < [Ere— Sal +... + [Ene Sal 


5. Since PCXns Yn) S P%ns X)+ P(X, VAPDs Yn)s 

P(X ns Yn) — P(X, Y) S PCKny X)APVs Yn)» 
Similarly P(X, Y= P(Xns Yn) < P(X, Xn) +P Vn Y)» 
Hence lex, Y= Pn ¥n)| < P(X, Xn) + PCY, Yn) 


6. To prove M3 put p(x, y) = a, p(y, z) = b, p(z, x) = c, so that a+b-—c > 0. 


pee (a+ b—0)+.ab(2+0) 
(+a)0+5)(1+0) 


Pp, o are equivalent, for if p(x, x) > 0, then 


a(x, y)+o(y, z)—o(x, z) = >0. 


= Pm), 
Em = TL olxm, X) 
and if o(x,, x) > 0, then 
_ _F(Xny X) 
P(Xn, X) = Io, x) 


7. Example: on R', p usual metric and o as in 6. Then o(x, ») < p(x, y), but 
a(x, y)/p(x, y) = 1/(1+|x—y|) > 0 as x > 00, 


8 o <p <7 < 20 < 2p; use 7. 

p(x, a) < 1 gives the disc D with centre a and radius 1. o(x, a) < 1 gives the 
square P with centre a and sides of length 2 parallel to the axes. 7(x, a) < 1 
gives the square Q with centre a and sides of length ./2 at 45° to the axes. 
P>)D\>\0; 


9. The sequence (x,) converges in (R', 7) if and only if x, is constant for all 
sufficiently large n. 


10. If he C, h(x) > 0 for 0 < x < 1 and A(@) > O for some «€e (0, 1], then 
1 
f A(x)dx > 0. For A(x) > 44(@) in an interval [a, 5] < [0, 1] and 


f Bheeveees f ” Haddx > $h@N(b—a). 


This proves M1 for o and 7, M2 is obvious and so is M3 for T. 
To prove M3 for o adapt the argument for the usual metric in R": M3 is 


equivalent to 
Sie <(fe) (fv) © 


and this follows from the fact that 


ihe {Ed(x) + Y(x)}'dx > 0 


for all real &. 
7 < @ follows from (*) with y = 1. 
In (C, o) and in (C,7), f, > 9, where O(x) = 0 for 0 < x < 1. If (f,) con- 
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verged in (C,p) to f, say, then, since o(f,, f) < p(fn, f), fr would have to 
converge to fin (C, 7) also. Thus f= @. But p(f,, 9) = 1 for all n, ie. fa +> 6 
in (C, p). 

In (C, 7), &n > 9. If (gn) converged in (C, 7), it would have to converge to 0. 
But o(g,, 9) = 1/,/3 for all x, Also convergence in (C, p) would imply conver- 
gence in (C, ¢). 


11. o, < Oo, < G3 < nO, < NO, 


2(5) 
2. If V is a normed vector space and p is defined by p(x, y) = |x—y]|, then 
Plax, 0) = |ax—6l| = llaxl] = |||]. 


Hence, if V has an element other than the zero element, then p(x, y) takes all 
non-negative values. 


3. The condition for |.||,, ||. ||, to be equivalent is that ||x,|, > 0 if and only if 
|xnlla > 0. ‘ 

Suppose that there is no # such that ||x||, < |x|, for all xe V. Then, for 
every integer 7, there is an x, such that 


[xnlla > mln. 


X, + 9, since otherwise ||x;||, = 0. Let 
Xn 


r=. 
"alesis 


Then ||y,||; = 1/2 > 0, but ||ynlp > 1 for all n, Hence there is a so that |x|, < 
|x|], for all x and clearly ~ > 0, Similarly there is a « > O such that |x|], < 
k||x||, for all xe V. 


4. If an inner product exists, 
|xt+y]? = @&+y). x+y) = [alt +x.yty.x+ [yl 
so that 2re(x.y) = |x+yll?—[]x1?— [ly]? 
Similarly 2im(x.y) = |x+iy*-||x|)?—|lyl]?. 
6. x.0+x.0 = x.(0+0) = x.0. 
7. Take R® with ||x|| = max (|x|, |x2|). Ifx = (1, 0), » = (0, 1), 
x+yll?+lx—yl? = 2, 2(l]x[]?+ lly?) = 4. 
(Or |x|] = |xi]-+ |xal-) 
8. [Xn Yn—X-I| S |Xn-On—Y)1+ 1-2-9] 
< [xnll yn—y] + len— ll [yIl- 
9. Proof of N 2. Theorem 2.21 clearly holds in this situation. Then 
[x+y]? = @+y).@+y) = |x|?+2re@x.y)+ lly? 
S | x|?+2|x.y|+ [yl]? 
< (x +|91)* 
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2© 


1. X contains a countable subset S. Denote the (distinct) members of S by 
4, X1, Xz»... Let p(x, x) = 0 (all xe X), p(x, y) = 1 (x + y; x, y not both in S$), 
PXms Xn) = |m—n-|, p(a, xn) = n-. M3 requires checking. 


2. If c is a limit point, there is a sequence (x,) such that p(a, x,) < r (all n) and 
Xn > c. Since p(a, x») > p(a, c) (exercise 2(a), 5), pa, c) < r. 


3. If the supremum (infimum) did not belong to the set, it would be a limit point 
outside the set. 


4. Let c be a limit point of E*. Given ¢, B(c;¢)—{c} contains an x € E*. Let 
6 be such that B(x; 3) < B(c;¢)—{c}. Since B(x; 4)—{x} contains a point of E, 
so does B(c; €)—{c}. 


5. Each open set contains an open ball which contains a point with rational co- 
ordinates (cf. exercise 1(c), 10). 
No. If R" is given the discrete metric, every set {x} is open. 


6. (i) K is the union of all open sets G ¢ E. Every G ¢ E° and so K < E°. 
K > E°, since E° is a G. 

(ii) His the intersection of all closed sets F > E. Every F> Eandso H > E. 
Hc E, since E is an F. 


7. For any xe X, there are three exclusive and exhaustive possibilities: for 
every ¢, Bix;6)N E+ @ and B(x;e)NE’ + 2; for some e, B(x;6)NE= 2; 
for some €, B(x;6)N E’ = @. 

xe(E) <> x ¢ E = for some ¢, B(x; ¢)N E = @ <> for some ¢, B(x; 6) ¢ E’ <> 
xe (BE), 


8. By 7 (2nd part), E’ = (E°). Use (2.31). 


9. (i) xe E,U E, + there is a sequence (x,) in E, U E, such that x, > x <> there 
is a sequence (x,,) in E, or in Ey such that x/,>x<xeE, or xe E,>xe 
E,u E,. Use induction. 

For arbitrary collections, the right to left implications hold. Also, if in R* 
(usual metric), E, = {1/n}, UE,—UE, = {0}. 

(ii) x €  E > for every ¢, B(x;¢) contains aye E = xe E for every E> 
xeENne. 

If, in RY, £, = {1, 4, 4, ...}, Ay = {-1, -4, -4,.., ANA = 2, E nk, = 
{0}. 

ii) (E,n ... N Ey)? = ETN... N Ee; (NE)? | N°; (UE)’ > UE. 


10. Use the sequence definition of limit point. For E° use 7 (2nd part) or in- 
variance of open sets and 6 (i). 


W.coDpereDcC=C, 


3(@) 
1. f(x, mx*) = m/(1+m’). 


2. If (xn), (x,) are sequences in E—{x,} with limit xo, then (x) = (x1, x/, X», 
X}, «..) is of same kind. Since limf(x%) exists, limf(x,) = limf(x;,). Apply 
theorem 3.1. 
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3. Given ¢, there is 6 such that o(f(x), yo) < € whenever 0 < p(x, Xo) < 4 
and xe E. There are infinitely many such x (xp is a limit point of E) and so 
B(yo; €) contains points of f(£). If fis injective, B(yo; €) contains infinitely many 
points of f(E) and so does B(yo; €)— {Yo}. 


4. Take ¢. There is 7 such that 0 < p(y, yo) < 7 and ye E = 7(g(y), Wo) <6. 
There is 6 such that 0 < p(x, x9) < 6 and xe D = a(f(x), yo) < 9. If f is 
injective, there is at most one x for which f(x) = yo. Then 6 may be chosen so 
that 0 < p(x, x») < dand xe D = 0 < o(f(x), Yo) < 7. 

Example: D = X¥ = E= Y = (0,1), f(x) = 0(0 < x < 1), g(0) = 0,2()) = 
1(0 < y < 1). g() +1 as y +0, but A(x) = 00 < x < 1). 


5. By theorem 3.1 (necessity), if (x) is any sequence in E— {xo} with limx, = Xo, 
then $(x,) > %, W%n) > B, £%n) > Yor BC%n) > Zo aS n> 00. By exercise 2(b), 
8, PxfOn)+V One (%n) + tyot+Az> and (3.11) follows from theorem 3.1 
(sufficiency). 


3(b) 


1. fcontinuous on X, Let x ¢f-(F). There is (x,) in f-(F) such that x, > x. 
S(%)¢F. Since f is continuous at x, f(%n)>/f(x) and, since F is closed, 
S(x) € F. Thus x € f-(F). 

f not continuous on X. If f is discontinuous at x, there are ¢ > 0 and (x,) 
such that x,>x, but o(f(x),f@)) >« Let S= {f (x1), f(%), ...}. Then 
f(x) ¢ Sand so x ¢f-(S). Thus f-(S) is not closed. 


2. Suppose f continuous at x9. If N is open and f(x) € N, there is ¢ such that 
B(f(xo);€) < N. There now exists 6 such that x € B(xo;4) implies f(x) € 
B(f(xo); 6). Take M = B(xo; 8). 

Converse. Given ¢, take N = B(f(x,); €). There is an open set M such that 
x9 €M and f(M) ¢ N, There is 6 such that B(x»; 6) ¢ M. 


3. Define fon R? by f(x) = 0 (x rational), f(x) = 1 (x irrational). Take E to be 
the set of rational numbers. 


4. Continuity of f obvious. Let y be a limit point of Y and let y, > y, where 
Yn * y. Then f(y.) +> fy), for otherwise f(y) would be a limit point of X. 

Take X = {0,1,2,...}, Y = {0,1,4,4,...} and use metrics induced by R'. 
Take f(0) = 0, f(n) = 1/n (n > 1). 


5. p,o equivalent <> (X,p),(X,c) have same open sets <> J, J~* continuous 
(theorem 3.23). 

Let p be the discrete metric and o the usual metric on R. Then J: (R', p) > 
(R', o) is everywhere continuous, but J- : (R', 7) > (R, p) is nowhere continuous. 


6. G = [2, 3], F = (0, 1). 
7. g((—%, —1)) = g((—%, 0)) = (0, 4/e]. 
8. If p is the usual metric in R", 
max] fi@%) —fi20| < PLC), f)) < LLG) — AO. 


‘ 
Let f: R” > R" be linear and have matrix (a;;).f; is continuous at x9, since 
\fio)—L@)| < (laia| +... + |sml)]%0— >I]. 
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9, If w is any one of the equivalent metrics on ¥x Y, 


A(X, Yo)s Xo» Yo)) = PC, Xo), (Xo Y)s (Xo, Yo)) = TCV, Yo) 
For the example take f: R? > R' defined by 


Kole: [Fe when (x, y) + (, 0), 
0 when (x, y) = (0, 0) 
and x9 = Yo = 0. 


10. Let ¢,(x) = (1—x)" for 0 < x < 1. Then |//(¢,)|\/|Pnl| = 2. 


11. Let a = (@,,...,a,). By Cauchy's inequality, |f(x)| = |a.x| < |jal) |x|, 
for all x € R". Also |f(a)| = |\a\|?. Hence ||/|| = ||al|. (@ = @ included.) 


par be < |z| | £0! < |g\| |F\) |x|. f0f is the identity function J on U 
and ||J|| = 1. 
Let U be R* with |x| = max (|x,|, |x2|), let V be R® with norm |x| = 
|xy|+ |x2|, let f: U > V be defined by f(x) = x. Then 
|i] + lal max(|2y], |e) _ 


Il = su axils ia 2 N= sue isi 


3(c) 

1. If7 is metric on E induced by (X, p) or (Y, 7), then (E, 7) is a metric subspace 
of (X, p) [((Y, )] and so E£ is connected in (X, p) [(Y, o)] if and only if (E, 7) 
is connected. 
2. Let G,NG.N {x}= B, G,U G,> {x}. If xe G,, then x ¢ G,, ie. G.N {x} = o. 

Let E contain at least two points and let x be an isolated point of E. There is 
6 such that B(x; 6) E = {x}. Take G, = B(x; 45), G, = (G,y’. 
3. X connected < E, E’ not both closed (all E+ 9, X)<> Et E or E’ ¢ E’ 
@ll E + 2, X)+frE = EnE’ +o (all E + 2, X). 
4. Let S be set of irrational numbers and let E(<S) contain x, y, where x<y. 


There is a rational r such that x <r<y, Take G, = (—~,r)NS, G, = 
(r, o) NS. 


5. If G is open and Gn E + @, then Gn E + @. For let xe GN E. There is & 
such that B(x; 6) < G and B(x;3)n E +2. Hence, if E is not connected, 
so that there are G,, G, with 


GiNE+2, GNE+9, GnG,nE=9, G,UG,>E, 
then GNE+2, GNE+%, GNGNE=2, G,UG,>E, 
ie. E is not connected. 

No. Take E = (0, 1) U (1, 2). 


6. If C is a component of a closed set F, then C © FandC F = F. By 5, 
C is connected. Since C > C and C is maximal, C = C. 
No. See 4. 


7. f:(0, 1] R® given by f(x) = (x, sin (1/x)) is continuous. Since (0, 1] is 
connected, by theorem 3,34, so is E = {(x, y)|(0 < x < 1, y = sin (1/x)}. By 5, 
E = Ev (x, y)|x = 0, —1 < y < 1} is also connected. 
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3@) 
1. If (x,) is any sequence in E—{xo} with limit x», then lim f(x,) exists. Apply 


n> 


exercise 3(a), 2, 
2. s, ->e in R', Hence (s,) is a Cauchy sequence in R' and so in Q. 
1 1 y 

Ne— a he 

0 < qi(e—s,) 7a Gti a 


Ife = p/q,q!e is an integer (as well as q!s,) and so is q!(e—s,). This is false by (*). 
Hence ¢ is irrational and (s,) cannot converge in Q, for if it did (s,) would have 
two distinct limits in R*. 


<1. (*) 


3. Let d(x) = (x"+1)"" © < x < 2). (dn) converges in B[0, 2] to given by 
1 for O<x<l, 
ator aye, 


for p(¢n, 6) < 2(2!"—1), Thus (¢,) is a Cauchy sequence in B[0, 2] and so in D. 
Since ¢ ¢ D, (dn) cannot converge in D, for if it did (%,) would have two limits 
in B(O, 2). 


$x) = | 


4. (n) is a non-convergent Cauchy sequence since n/(1+m) 1, but there is no 
real x such that x/(1+|x|) = 1. 


5, No. Let p be the usual metric on R! and o the metric of 4, Then p, 7 are 
equivalent; for f: R!> R® given by f(x) = x/(1+|x|) is continuous and strictly 
increasing, so that f(x,,) > f(x) if and only if x, > x. 


6. (i) & is a collection of complete subsets E of X. Put H= 1) E.IfH= 9, 


Eeé 
then H is complete. If H + , let (x,) be a Cauchy sequence in H and so in E. 
There is an x € E such that x, > x. Limits in ¥ are unique. Hence x is the same 
for all E, and xe H. 

(ii) We need only consider two complete sets £,, Ey. Let (xn) be a Cauchy 
sequence in E,U Ey. At least one of E,, £:, say £,, contains an infinite sub- 
sequence (x,,). Since E, is complete, there is an x € E, such that x,, > x. Since 
also (x,) is a Cauchy sequence, 


AX, Xn) S P(X, Xy_) + Pps Xn) > O. 


7. Let xn€ Fue If m,n > Noy P(Xms Xn) < P(Fu) and as p(F,) +0, (xn) is a 
Cauchy sequence. Since (X,p) is complete, there is an x such that x, > x; 
and since each F, is closed, x € () Fn. If x’ € 1 Fy, then p(x, x’) < p(F,) for all n 
and so p(x, x’) = 0, ie. x’ = x. 

(i) X¥ = (0, 1], F, = (O, 1/n] (closed in X). 

(ii) X = R', F, 0, 1/n). 

(iii) ¥ = R', F, = [n, ©). For a counter example with bounded F,, let X = 
C[0, 1] and let F,, be the (closed) set of continuous functions fon [0, 1] such that 


fO) =0, 0<f(x) <1in(0,1/n), f(x) = 1 in [1/n, 1). 


Then p(F,) = 1 and F, = @, since there is no continuous fsuch that (0) = 0 
and f(x) = 1 in U[1/n, 1] = (©, 1]. 
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0 O<x<i}), 


8. das) = "0 <x <0), a = | ene 


Pn, 6) = 1 for all n. 
9. Let (¢,) be a Cauchy sequence in L(V, W). For any xe V, 
Iom)—Pn(X)|] = m—Pu2||_ < |'bm—Pnll lh 
and so (¢,(x)) is a Cauchy sequence in the complete space W, 
Define ¢: V+ W by ¢(x) = lim ¢,(x). Then 
H(ax+ Py) = lim $,(ax+ hy) as {apn(x)+Pen(y)} = 2P(x)+ P60), 


ie. ¢ is linear. 

Since (¢,) is a Cauchy sequence, ||¢,|| < A, say. (Adapt first stage of proof of 
theorem 3.42.) As ||¢(x)| = lim ||¢,(x)| < Aljx||, by theorem 3.24, ¢ is con- 
tinuous. 

Given ¢, there is m) such that ||¢,,—¢,|| < ¢ for m,n > mp. For any xe V 


and > M16) —9,0)] = lim In) $a00)] < ell. 


Thus |}—¢,|| < € and so ¢n > ¢. 


0. [a,b] is complete and /: [a,b] [a,b] is a contraction mapping since 
ire) —S%)| = |f'O)Ga-%2)| < klx1— xl. 


11. Define 2 on Bia, 6] by 
ADE) = ¥O-S, ¥O))/M (yr € Bla, 6), x € [a, b). 
Since (x) is bounded for a < x < 6, so is f(x, ¥(x)); hence Q(y/) € Bla, b]. Also 
2GYE) = 2G/2)0)| = [[YiG)— YOO — ACs, /M)| 
S$ |~A@)—Ya0)|C—m/M), 
Le, PG), AY2)) < A —m/M)pCh,, vr). 


Thus Q is a contraction mapping and there is a unique ¢ such that Q(4) = ¢, 
i.e. f(x, $(x)) = 0. Moreover, there are no unbounded solutions. The argument 
at the end of the proof of theorem 3.47 shows that ¢ is continuous. 


12. Put M = [xo—@, x9+a], N = [yo—b, yo+5] and define 2 on C(M, N) by 
2) = yor [My WOM Gre COM, N), xe M) 


OQ) is continuous (C1, theorem 7.61) and, for x e M, 
|QG)Q)—yo] < |x—xo|B < aB < b, 
ie, Q()(x) € N. Also 
lay re)—ar360) < | [re Orso, vai 


< [Avno-vacrar < adplhy tr) 
i 


and so Q is a contraction mapping. 
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13. (i) Q(x)—x = 1/(1+e%) > O for allxeR'. (ii) For all distinct x4, x2, © R’, 


1 1 
[2Gq)- 2@2)| = | (1 —%2) + (ae ten - 4) 
Ga 
Gi-2 (1-5) 
14. Since a fixed point of Q is a fixed point of 2”, 2 cannot have more than one 


fixed point. 
Let x be the unique fixed point of Q”, Then 


QPA(X)) = NCM()) = QQ), 
i.e. A(x) is a fixed point of Q, Hence Q(x) = x. 


15. Take ¢,(x) = 1, $2(x) = 0 on [0, 1]. Then pli, $2) = p(Q(P1), 2(2)) = 1. 
By integration by parts, 


POM), QY)) = sup 18 (x 1d) —YO}dt < 40, Y). 
o<a<1 Jo 


< |x1— Xa]. 


3(e) 
1. Let (Xo, 0) be a subspace of (Y, ) isometric with (X, p). Since X, is closed, 
by theorem 3.43 it is complete in (Y, 7). (Yo, ®) (¢ restriction of o to Xo x Xo) 
is a completion of (X, p). 


2. Take X = set of non-negative rational numbers, Y = [0,), Y, = [1, ©), 
all with metric induced by R’. 


3. For any xe X+, there is a sequence (x,) in X convergent to x. (Q(x,)) is a 
Cauchy sequence in X, since 


P(X), Ln) < KPC ms Xn)s 
and so has a limit in X*. If also x), > x (x), € X), then 
P(AEn), AOKL)) < Kens Xp) + 0 
and so lim Q(x;,) = lim Q(x,). Hence define Q+ on X* by 
O+(x) = lim Q(x,). 


The restriction of Q* to X is Q, since, when x € X, a sequence from X con- 
verging to x is (x, x, ...). 
Q* is a contraction. If x, ye X* and x, > x, Yn > Y (Xns Yn © X), 


P(QCEn)» Ln) _ PQ), LO n)) PO"), at(y)) 
POny Yn) P* ny Yn) Pay) 


Since I.h.s. < k for all n, r.h.s. < k. 
Qt is unique. Any continuous /: X+ > X* which extends © satisfies f(x) = 
lim O(%,) (x € X*, Xn © X, Xn > X). 


3) 
1. A subsequence (x,,) of a sequence (xn) converges in (X, p) if and only if it 
converges in (X, 0). 
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2. Let E be a compact set in (X, p) and let (x,) in E converge to x € ¥. There 
is a subsequence which converges in E. Since every subsequence converges to 
x, x € E. Use theorem 2.31. 


3. Let n(x) = 1 for x = 1/n, 0 elsewhere in [0, 1]. If (%,,) is any subsequence of 
(bn), PCDry» Pv) = 1k + 1) and so (¢,,) does not converge. 


4. If x, +> x, there are a subsequence (x,,) and an ¢ > 0 such that P(Xy4, X) > € 
for all k. By compactness, (,) has a convergent subsequence (&y,)» Since (%,,) 
is a subsequence of (x,), Xyy, > Xe Contradiction. 


5. (i) F closed, E compact. Use theorem 3.63: Ef F is a closed subset of the 
compact set E. 


Let & be a collection of compact sets E. Since each E is closed, H = (¢) is 
Heé 


closed. If E* is any member of E, H = E* 1) H is compact. 

(ii) We need only consider two compact sets E,, E,. Let (x,) be a sequence 
in EU £,. At least one of E,, E,, say E,, contains an infinite subsequence (xy,). 
There is a subsequence @,,) of (x,,) and so of (x,) convergent in £, and so in 
E, UE. 

6. (X, p) compact, (F,) contracting sequence of non-empty closed sets in X. 
Let xn € Fy. (%n) has a subsequence (x,,) converging to an x € X. For any n, 
© 

x,, © F, if y > n and since F, is closed, x € F,. Thus x € 1 F,. 

n= 
7. Takee > 0, Thereis b > asuch that |f(x)—/| < 4efor x > b. When x,, x, > 
b, |\f()—f(%2)| < €. Also fis uniformly continuous on [a, b+ 1] and so there is 
8(0 < 6 < 1) such that | f(x,)—f(x2)| < € when x, x: € [a, b+ 1Jand |x,—22| < 
é 

If |x,—x:| < 6, then x,, x. €[a,b+1] or x4, x,€[b,%©) (possibly both). 
In either case, |f(x,)—f(x2)| < ¢. 


8. fnot uniformly continuous: if 6 > 0, (x+6)*—x* +0 as x >, 

g,h,k uniformly continuous: |g(x,)—g(x2)| < |x1—x2|; for A use 7; for k 
use argument similar to that in 7, since |x}—x}| = |x,;—x9|/(x$+x}) <e¢ 
if |x;—x,| < 1 and x,, x, > 5, say. 


9. There is 5 such that | f(x,)—f(x2)| < € when x, x, € [a, 6] and |x,;—x2| < 6. 
Let a= Xo < % < 0. < Xn-y < X= 5b, where x,—x,-, < 6(/ = 1,...,.n). 
Define / on [a, 5] by putting 


A(x) = f(x) (@=0,1,..., 7”) 


and letting h be linear in each [x;-1, x;]. If x € [x;4, x] and x = (1—)x,_,+ax, 
(0 <a < 1), then 


\A@)-FO)| = |A-&) fi) + @fe)—F00)| 
< (1-2)|fGi-)-£Q)| + 2|f)-fQ)| < €. 
10. fis uniformly continuous, for 


I) —G.ICO| = re-#0] < Fi #1 < 0,49 
and so p(S(G), G4)) < ply $4). 
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g is continuous. For let ye C[0, 1]. Then |y(x)| < A, say, where A > 0. 
If p(y, x) < 0 < A, 


le@)@)-gQ)d| = 


[u-we+n 


and so p(g(y/), g(x)) < 3A6. But g is not uniformly continuous. For if (x) = n, 
Xnlx) = n+1/n 0 < x < 1), PY ny Xn) = 1/n, while pen), 8Xn)) > 2. 
11. There are sequences (x,), (Y,) in E such that p(xn, ¥,) > P(E). (x,) has a 
subsequence (x,,) which converges to a point x¢ E. (y,,) has a subsequence 
(,,,) Which converges to a point y € E. Since x,,, > x, p(x, y) = p(E). 

Take X = B[0, 1] with usual metric, and E = {¢,, 2, ...}, where 


Pree { 


Since p(¢m, ¢n) = 1—1/n (m < n), a sequence of distinct points of E cannot be 
a Cauchy sequence. Hence E has no limit points and so E is closed. p(E) = 
but there are no m, n such that p(¢,,, $n) = 1. 


< 6QA+6) 


1-1/n_ when x = 1/n, 
0 elsewhere in [0, 1]. 


12. inf p(x, z) < inf {p(x, »)+ p(y, 2)} = p(x, y)+ inf p(y, z), 
sek zeEk sek 

ie. p(x, E)—py, E) < plx, y)- 

Similarly PY, E)—p(x, E) < ply, x) 

and so |p(x, E)—p(y, E)| < px, y). 


p(x, E) = 0 every B(x; €) contains a point of E<> xe E. 


13. There are sequences (x,) in A, (),) in B such that p(%n, Yn) > P(A, B). 
(Xn) has a subsequence (x,,) converging to a point a€ A and (y,,) has a sub- 
sequence converging to a point b € B. Then p(a, b) = p(A, B). 

In R" take A compact, B closed. For a suitable finite, closed interval J, p(A, B) = 
p(A, BND). 


14, (i) A compact, B closed. Suppose p(A, B) = 0. Take (x,) in A, (y,) in B 
such that p(x,, Yn) > 0. (x,) has a subsequence (x,,) converging to an xe A, 
Then y,, > x and, since B is closed, x ¢ B. Thus AN B+ 2. 

(ii) In BlO, 1] take A = {4}, where (x) = 0 for0 < x <1, B= {¢y, $y ...}, 
eee 141/n wh 1) 

nm when x = 1/n, 
P(x) = { ; 
0 elsewhere in [0, 1]. 

A is compact, B is closed (cf. 12), p(A, B) = 1, p(¢, dn) > 1 for all n. 


15. X = R', A = (2, 3,...}, B= (2+4, 3 +4, ...}. 


3(g) 


1, Let E be a set in (X, p). Suppose E < o Bens 1). If a is an arbitrary point of 


X and r = max p(a, cy), then E < Ba; rat 
1<n<p 
Let X be an infinite set, o the discrete metric on X, Then X is bounded in 


(X, 2), but not totally bounded. 
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2. Let E be a set in (X, p). E can be covered by a finite number of open balls 
with radius 1/k. Hence there are infinitely many members of (x,-; ») lying in 
one such open ball, 

If m,n > Mo, Xm,m and Xpq,n lie in an open ball of radius 1/m) and so 
P(%m,my Xn,n) < 2/No. 


3. Suppose f: (X, p) > (Y, 7) continuous, (X,p) compact. Let « > 0. Given 
ce X, there is d(c) such that o(f(x),f(c))<¢ when xe B(c; d(c)). 
{B(c; 44(c))|c € X} is an open covering of X. Let {B(c;; 4(c,))|1 < i < n} bea 
finite subcovering and put & = min{d(c,), ..., 5(cn)}. Let p(u,v) < 46. If 
ue B(c;; 44(c,)), then u, v € B(c;; 8(c,)) and so o(f(u), f(v)) < 26. 


4. The set of (x—d(x), x+4(x)) (@ < x < f) is an open covering of [«, /]. 
There is a finite subcovering corresponding to x, ..., Xn, Say. Suppose 


at ei ae A a ee EON iH 


Put o(x,) = 4; (x;—4;, x; +6) = 1, We may suppose that no J, contains an 
LG +). 

For i=1,...,2—1, J, and J,,, have a common point y; such that 
X; < Yi < Xiy1. (Otherwise there would exist z such that x,+4; < z < X441—-On4 
and zeJ,, where j <i or / > i+1; and then J, ¢ J; or Ji, S Jj.) Hence 
f(x) < f(%i41). But @) < SO), On) < f(A). Hence f(@) < f(A). 


4(a) 
1. O. (a) Yes. (6) No: x, = 20. 
0. (a) No: Xn = (4)", Un = (4). (6) Yes. 
~. (a) No: x, = G)"+(4)", Un = GA)". (6) No: x, = 1+(1/n), oy = 


1 ~ 
2. @35< ete = Gaga A= Ex 


ps t< +f" =dx = 1+logn. 
(iii) If -1 < k < 0, Br < is |" x*dx. If k > 0, Erk < nat, 


3. Un—Un = {(Un/0n)— 1}0, > 0. Counter example: u, = n+1, 0, = n 


4. (Xn41—Xn) increases. Hence the bounded sequence (x,) either decreases or 
eventually increases. 


5, (i) For |x| < 4, say. 
|log(1+x)—x| = |—4a+4x%—...] < dfx + |x] t+ x]?+...) < [xl% 


(i) a > 0: (7) +0 and so 


& (() -- (+ax)| < K(|x|?+|x|?+... 


a < 0: by above, 


(i+x)* = d 


ae OG 1+ax—O(x*)+ z {ax —O(x*)}", 
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6. The inequality follows from the fact that, in [-—4, r+4], the curve y = 1/x 
lies between the tangent at (r,1/r) and the chord joining (r—4, 1/(r—4)), 
(+4, 1+). 


ay penthy 1 1 1 
it” ley 30 be) eae) #9 Up): 


fa! T 1 1 7 
L0<> -— < : . 
ute: TZ n+x? 2x ~ xt+1 el ale? eae 


4) 
1. If the upper and lower limits are finite, x,/v, is bounded by theorem 4.21. 
Converse obvious. 


2. lim sup xX, = 00 <= sup x, = 00 <> given K>O, there is m such that 
X, > K <> there is (v,) such that Xp, > 0. 


3. (i) Nothing to prove when lim inf x, = —0o. Otherwise (x,), (vn) bounded 
below and inf x, < x, < y, for all s > n, so that inf x, < inf y.3 let n > 00, 
ren r2n san 
4, infx,+infy, < x,+y,(alls), soinfx,+infy, < inf (x,+).). X»+¥s < X,+supy, 
(all s), so inf (x,+y,) < inf (x,+sup y,) = inf x,+sup y,. 
For < everywhere take 


Gn) = 1, —1,1, -1,...), On) = (-1, 1, 0,0, —1, 1, 0,0, . 
5S. Gn) = (1, 2, 3, 1, 2, 3, ...), nw) = (3, 1, 2, 3, 1, 2, ...). 


6. (i) (a) Let A = lim inf x,. There is a subsequence (x,,) such that x,, >A. 
Then xy,¥_, > Ay. If x,%,>¢, then, since y > 0, x, = Oy )/Y, > cy 
As c/y > A, c > Ay. Hence no subsequence of (x,¥,) has a limit <Ay and so 
Ay = lim inf (%nyn). 

(6) If lim inf x, = 0, then x,>00 and x;y,>0. If liminfx, = — ©, 
there is (x,,) such that x,, > —00; then x,,9,, > —%. 

(ii) x, = n(n odd), x, = 1 (n even), y, = —1/n make (a), (d) false. 

(iii) If y, > 0, then Xn¥_ > 0. If yn > y < 0, use (i) (a), (c) and (4.23). 


7. Let lim inf x, = A. Given € > 0, take 5 > 0 so that |f(A)—f(x)| < € when 
|A—x| < 6. Since x, > A—6 for n> no, say, f(xn) > f(A—48) > f(A)—e for 
n> no. Similarly f(x,) < f(A)+e for infinitely many 7. 


8. First inequality: Let lim inf (u,/v,) =A. Nothing to prove if A= — 
If A finite and € > 0, u, > (A—€) vp for n > N, say. Then, 
Sn oe SN Hepat stun > Sy 
thoy ty 


for n > N’(>N), say, since t, > 00, Thus lim inf (s,/t,) > A. If A = 00, un/t_, > 00 
and, by similar argument, s,/t, > 00, 


MA aN A-3e 


9. (i) Un = Xn, Un = 1 in 8. (ii) uy = log xp, vp» = 1 in 8; use 7. (iii) For 
n> 1, replace x, by Xn/%n-1 in (ii). 


10. (i) tm = n*, vy = 1, Un = m4? —(n—1) (n > 1) in 8. (ii) xn = nin 9(iii). 
Gi) x, = n/n! i in 9 (iii) gives lim n/(m!)¥" = lim [1+(1/)]" = e. 
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gE Tf linniga(@) = |, lim g,(8) = /,, then lim max {g,(6), g2(5)} = max (4, /2). 
> é—0 60 


12. Let f be upper semi-continuous in [a, 5]. If f is not bounded above, there 
is a sequence (x,) in [a, 6] such that f(x,) 900. (x) has a subsequence (x,,) 
with limit c[a, b]. Then lim sup f(x) = © > f(c) (suitably modified if c = a 
ze 

or b). Similar argument shows that sup f(x) is attained. 
13. By the analogue of theorem 4.21 (ii)(c), Df(c) > 0 implies that f increases 
at c in the sense of exercise 3(g), 4. 

If Df(x) > 0 and «> 0, D{f(x)+ex} > 0. Thus f(x)+ex increases, i.e. 
S(a)+ex < f(P)+ef8 when a < « < # < b. True for all e > 0. 

Counter example: f on [0, 2] defined by f(x) = x (0 < x < 1), f(x) = x-1 
(<x <2). 


4(c) 
1, X(1/n*) converges, X(1/n) diverges. 
2. Xun, Lvp, where 
- {3 (a pad ={f (n odd), 


()" (@m even), 3” (n even). 
3. By 4(b), 7 and 9, 


i Mybecbundin = qiim sup (uy +--+up)/n im sup Un 
im sup a a <a <1, 


4. (i) converges, (ii) diverges. 
n! 


lin (n!)un 
= Gaal 


n 


n 


—in 


e i, by 4), 10. 


Gioia] -<Soth 
7. \a| < 1 and all 4, |a| = 1 and |b| < 1. 


4d) 

1. If lim inf (u,/v,) = A, lim sup (up/v,) = A, then 4Av, < uy < 2Av, for n > 
N, say. 
2. (i) Convergence for p > 1 and all g, p = 1 andg > 1. 

Gi) Uy = n708108" < n-* (n > N); Lup_ converges. 

(iii) up = nolo loelogn: Convergence. 

(iv) Un = en8o8logn* > e-losn = y-1 (n > N); divergence. 

(v) n--"/)/n-! + 1; divergence. 

(vi) un = O(1/n*). 


(vii) u,/n-* = (1 pa + e%; convergence for a > 1. 
pl 
+5 -+ On ; convergence for p > 2. 


SA 2n 
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(ix) a > 1: (eV 1084—1)/(1/n) > loga > 0. 0 < a < 1: (1—e™ 1082) /(1 /n) 
+ —loga > 0. Hence, when 0 < a < 1 or a > 1, series converges for k > 1. 
When a = 1, series converges for all k. 


(x) {eto8™" — 1}/{(log n)/n} + 1; convergence for k > 1. 


— Kiser)" eee | ( ~ iver) 
3: (1 s [5- n* exp {n log {1 7 


2, (2, 
= n* exp {n [ te "+0 (%*) J} = exp {0 (oe ")| >1. 
n n n 
4, toe 


aD \t A 
72 a Tike > ae. Xu, converges for 0 < a < I/e, diverges for a > 1/e. 
In 


s 
For a = 1/e, “#1 = (1+) . We show that 
Os e n, 


B(1+3)"> (142)" =f, (*) 


so that Eu, diverges by theorem 4.41. To prove (*) it is sufficient to show that 
ntl 
(1 +) decreases (to e). We have 


e+h 1 1 1 +1 
adi (1+) = [ tos (+{)-3] (1+) <0. 
dx * x) % x, 
5. (p—1)(uy + Puy + p7tye +... + p"Uyn) 
2S (Uy t... Fup) + Up + -0. + p2a) + oe + (pn + oe + Uynti_y), 
(p—1) (Uy + puyet ptuya+ ... +p" "Uyn) 
S (Ug... Fly) + (Uppat oe. Ppt) + ont Upnmtg a + oo pn). 
Xn-* convergent <> X(2*-!)-" convergent <> k > 1. Use induction. 
6. =(u,/s,) diverges, for, when p is sufficiently large, 
Hort» Mato 
Sut Suto Sap 


k > 1. The inequality is equivalent to f(x) = (k—1)x*—kx*1+1 > 0 for 
0 < x < 1 (x = 5,_,/s,). This holds since f(1) = 0 and f(x) < Ofor0 < x < 1. 


=% 
Sno — Sn 2, 


» 
7. Let © um = ra, SO that Un = raa—Pn Take v9 = Vrna—v ra 
n+l 


n 
8. Vn = Un/Sn, Where s, = Du, (use 6). 
T 


9. Un = uae (use 6). 
Qn Anti 


10. Take np = 0 and m, ng, ... so that 
Myrte. tin, > 1 and Unliin<4 for n>m, 
Us nite tian, > 1 and Us n/p, <4 for n> m, etc. 


Define un = Ux,» for nme <n < m1, Clearly Eu, diverges. Also, for every k, 
Un/ Uy, > 0 as n> 00, for, When n> Myy1, Un/Uxn < 1/24. 
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To construct the convergent series, take mp = 0 and 7, mg, ... such that 
Usnityn > 2 for n>m and UsniitUanseten < 1/2, 
UsnlUan > 2 for n> ng and Usnyitlanset-. < 1/2%, ete. 


Again define u, = Ux,» for me <1 < Mey 


4) 
1. (i) Divergence, since a" > 1. 

(ii) Convergence for x = km (kK = 0, +1, +2,...), otherwise divergence. 
We may take 0 < |x| <7, Then there are infinitely many n such that 
|nx —(2r+4)7| < 4|x|, for some integer r, and so lim sup sin nx > cos }|x| > 0. 
Also cos 1 < cos (sin mx) < 1. Hence (sin nx)/cos(sin nx) +> 0. 

(iii) Z(2)!/n" converges by theorem 4.32. 

(v) Absolute convergence for |x| +1 (theorem 4.32), convergence for 
x = —1, divergence for x = 1. 


(i) S (tet) = 5d-og x)x¥* <0 for x > e. Use theorem 4.53. See 


also 4(d), 2(x). 
(vii) Convergence for g < 0 and all p,q = 0 and p < 0. 
(viii) a sagas 4.54, 

(ix) red cos converges for all x by theorems 4.53, 4.54. cee sin= 
stein fon x* lobe (kK = 0, +1, +2,...) and diverges for x = 2k7, since 
sin (2k7/n) By 2kn 

logn nlogn 

(x) For « + 2km (k = 1,2,...), Eu, converges. For « = 2km, Uuq diverges 
since (2km)"" + 1 and 1/(2k7m) < 1. 


. Thus Eu, converges for x + 2k7m, 


2. (i) All x, by theorem 4.53. (ii) x = km(k = 0, +1, +2,...) only; use 
sin’nx = 4(1—cos 2nx), 


3. Series converges for all x, by theorem 4.53. Also 


sd . 
2(145+..+/) awe B(145+..+3) eae 
2 n} on 2 n n 


diverges when x + kz. |sin nx| > sin*nx. 


4. (i) If Za,n* converged for k > 1, ayn would be o(1), i.e. a, would be o(n~*) 
and so Za, would converge absolutely. 

(ii) Write a,/n? = (a,n-*)n*- and use theorem 4.54. 

Let A be the set of « for which X(a,/n%) converges. A + 2, since a, = o(1) 
and so «eA when « > 1. Also A is bounded below, by (i). Let %» = inf A, 
so that «¢ A when @ < a, By (ii), «€ A when a > a>, (%) may or may not 
belong to A.) 


4 - 
5. Let aq—1 = by. Then Sm = E(- 7+ 1E(- DY where 3\(—1)"b, +0, say, 
‘i x 


and r-pr = —I( odd) or 0 (” even). 
1 
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6. Extension of theorem 4.53: If s, = sae and Dy |v,—v,41| are bounded and 
v, > 0, then La,v, converges. Both extentions follow from 
Ont Untit +--+ Ante Ynty 
= (Sni1—Sn)(On41—Unsa) + «+» +(Snt-p—1— Sn) Ongr—1— Unt) + (Snip—Sn) Vp. 


Since f(x) > 0,’ strictly increases. If (xo) > 0 and £ > xo, then f’(&) > 0, 
Sx) = f'@) for x > &, and f(x) +0 as x00, Hence f(x) < 0 for x > 1, 
ice. f strictly decreases. Since f(x) > 0, f(x) > 0 for x > 1. As —f’ is positive 


and decreasing and i ‘ (—f) exists, 5) {—/()} converges. 
1 


Put v, = f(n) sin {log f(m)}. Then v, +0 and =|v_,,;—v,| converges since 
Jenga Pn < IFO) < 21FI. 


7. If lim inf (x,/v,) = A > 0, then, for n> N, say, up, > 4Av, and so Lu, 
diverges, 

(i) Un = (—1)"/ya, On = 1/n. 

(ii) uy = 1/yn when n = k* (k = 1, 2, 3, ...), Un = 1/n* otherwise; v, = 1/n. 


n 
8. To prove that >) u-T,-, +0 as n+, let |u| =o, sup|7,| = 7. Given 
r=0 
Ey 
€ > 0, there is N such that |7,| < ¢ and & |u| < for n > N. For n> 2N, 
nt 


|UoT n+ 220+ UnTo| < |WoTnt +--+ Mn—yTw| + [Un-yarTyn1t +++ UnTol 
S C(|Ug] +00. + [Upp ATUn—yaal +o. + [nl 
< (t+7)6, 
Example. up = v, = (—1)"/V(n+1). Then 
1 1 1 1 
Won = + A +t ones 
Mamet = TOR) 2a 1) Ig Qn) 


2 
Sn = {logpn—1)+ Yam»—-1}— Hlog(Pn—1)+Yp_-1}— HlOg an+ Yan} 


10. Since the terms of the rearranged series tend to 0, we need only consider 
San Let p, g be the number of positive and negative terms in 5, Let k > 1. 
Take € > 0. If n > N, say, p > nand |ra,—/| < € for r > 2g. Then 


San —(Qy— Ag+... = on) 
= Gant Ganga t oo + Gaya) + aera t Gara t «+++ Gan) — (Gan + Ganga +++ + Gep—2) 
1 1 1 1 1 1 
HU) (Ft tg) dre) (Sjt-+h) sare (+44), 
where |é,|, |és|, |€| < ¢. 


9. Let Yn = (145+..+2) og n, so that y, >y (Buler’s constant). Then 


11. By the absolute convergence of =(—1)"/n* with k > 1 and by 9, the series 
converges if k > 1. For k <1, the series diverges. Obvious when k < 0. 
For0<k <1, 


1 1 | a | 


fi 1 
Se >a a 
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4(f) 
1. @ Allz. 
(ii) z = 0 only. 
(iii) R = 1, since n™" < (nlog*n)!" <n" for n> N, say, and n> 1. 
Convergence for |z| < 1. 
(iv) R = 1. When z = cos 0+isin 9, series is 


s ‘cos nO | sin =) 
Z \log’n — log’n)* 
X(sin n9)/log’n converges for all @, X(cosn@)/log’n except for @ = 2km 
(k = 0, +1, +2, ...). Power series converges for |z| < 1 except z = 1. 
(v) |z| < 1. 
(vi) |z| < 1. 
(vii) @ = 0: all z.@ + 0: |z| < 1,z +1. 
(viii) |z| < 1, z + 1, 
(ix) R = 2. Find real and imaginary parts of (cos 3n4+i sin 3n9)/(1—in); 


convergence for |z| < 2 except z = 2, —1+iV3. 
(x) @ = kr (k = 0, +1, +2,...): all z. @ + kw: R= 1, since 


0 < lim sup |sin na| < 1 


(see exercise 4(e), 1 (ii)). When z = cos 0+isin 0, series is 


El 


sin n(w@+6)+sin n(@—8) , ,cos n(a—0)—cos mer} 
n n : 


Real component converges for all 9, imaginary component except for 
@ = 2kn+«. Power series converges for |z| < 1 except z = cosa+isin & 


2. @ Ife + 0,1, 2,... anda > a, 


BIH | 


n+1 
Use theorem 4.42. 
(ii) Since [1+(1/n)]* = 1+k/n+O(1/n), (*) holds if O< k<1+a, As 


1/n* +0, inequality (4.41) shows that \(?)| +0. Also (") decreases and 


()-c» 


ii) (3) 21. 


() | . Use theorem 4.53. 


3. R = 1. If the series is Za,z", 


an _ (nt+1)(c+n) _ 1+c—(a+b) 1 
dat (atm y(o+n)~ '* +0(7)- 


The argument of 2 shows that, if c—(a+b) > 0, Za,z" converges absolutely 
for |z| = 1 and, if —1 < c—(a+b) < 0, it converges conditionally for |z| = 1, 
z+1. When c—(a+h) < —1, Za,z" diverges for |z| = 1, since a,+>0. 


CHAPTER 4 473 
Obvious if <—1. If ¢c = at+b—-1,0 < ay/any, < 1+(A/n?) for n > N and, for 


aN: aw ies et 1 
log < <B, 
a Ae te 
i.e. a > aye. 


4. (i) If R = S, T, > R. When a, = 1, b, = —1 (all n), R= S = 1, T = 0. 
(ii) If a, = 1+(—1)", 6, = 1—(—1)”, then R = S = 1, T, = ~, 
(iii) If Za,x" = 14+2x+2x°+..., Db,x" = 1—2x+2x?—-2x8+...,R= S=1, 
T,= 


5. Za,z" converges for |z| < 1, since |a,z"| < ao|z|". Let |z| < 1. 
oO | jo co 
la-» (Eau2")—as = |2i(@n= ap)” < E(@1—a)l21". 
ff a = a, = a =..., rhs, = 0 < ap. If a, > ay 
a 
rhs. < ¥ (@n-1—-@n) = a@o—lim a, < ay 
1 


© 
Lastly, } a,z" = 0 implies |—a,| < a. 
0 


4(g) 
1. (i) Non-existent, —1,1. (ii) Non-existent, non-existent, 0. (iii) All 0. 
(iv) 0, non-existent, non-existent. (v) Non-existent, 0, 0. (vi) 0, 0, non-existent. 


2. Xin = N, Xmn = O otherwise. 
3. Suppose Xm, increases, lim Xmn = Vmy Alin 1m = =y. Since y, increases, 
n—>0 


Xmn < Ym < y. Hence, as m+, Xnn =e es y. Also z, increases and so 
Zn >zZ < y. Similarly y < z, 


4. Sufficiency. For n,n’ > 1, |Xnn—%nn’| < €. By completeness of Z, Xnn > x, 
say. If m,n, n' > No,|Xmnn—X| < |Xmn—Xnine| + [Xn —X| < 26. 


5. Let sup Xin = X, Xp > X—€. For m > ft, n > V,X—6 < Xmn < x. 


eas Siu < z sus, Z ous wes. 


t=1j=1 


7. Adapt the proof for ¥) u, (C1, 90 and 95) using 6. 
=1 
oo «© 1 5 
‘SS, (3 Spar a) exists if and only if k, / > 1; use theorem 4.74. 


m=1 


9. k > 2:(m+n)-* < (2mn)-*; use 8. 


k= 2: 3 tn > 3 (m+x)-tdx = (m+) 
n=1 1 


and so y ne > m+n) diverges; use theorem 4.74. 


m=1 \n= 
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mn 
10. Smn = Xj x Miis bmn = s > |uel, 
Gelteet 


i=1j=1 


2 
=> inn f= XZ [umn 
mn=1 mn=1 
Take € > 0. Then |Smn—s| < €, |tmn—t| < € if m,n > mo, say. Let g > 2m 
and let p = [4q] (the greatest integer < 4g). Then 


< ZX |umnl < ta typ < 26 
mnsq 
min>q 


a 
s— ie, 


r=1 


< 3e. 


and so 


UW. If o=a+if, wo =a'+if’, af’ + a’ f.|mo+no'|* = am*+2bmn+cn’, 
wherea > 0,c > 0,ac—b? = (af’—a’f)* > 0. Then A(n+n)* > |mot+no’|* > 
Bmn, where A = max(a, c) > 0, B = 2(\(ac)+) > 0. Use 8, 9. 


12. Let |z| < 1. Elem | = |z|"/1—-|z|") < |z|"/(1—|z|) and sod (lI) 


wo 
exists. Hence >) |z”"| exists. 
mona 


e 
Let >) z™ = s. Since 
m,n=1 
21+ 2")/(1—2") = z+ 2(en ng znttiny |), 


E(E)+3 (2,-)-++ 352. 


The second term is z z"/(1—z"). Also, as p > ©, the first three terms tend to 


s; hence so does the | last. 
13. Let |z| = r < min(R, 1), r <p < R. limsup|a,|"" = lim sup|5,|"" = R- 


and so |a,|, |b,| <p for n> N, or |an|, [On| < Ke" for all n. Hence 
D|b,| |z”"| converges and 

call x ‘, 

n =r"lp < pr" 


so that = (3 DY lam| [bn ie) also converges. = theorem 4.74, 


men Ei (Sune) - 5 (Sater) 


m=1 \n=1 n=1 \m=1 


a aL | |2m"| < Ky 


and this is the desired result. 

The disc |z| < min(R, 1) cannot be replaced by |z| < R. For if R < and 
|z| > 1, |z|" > R for large and for these f(z"), g(z") are not defined; while 
if R=, La,g(z"), Lb,f(2") may diverge if lz) > 1 (g. a, = A = ial: 
z=x> 1), 


CHAPTER 5 475 


5(@) 
1. If M(X) = sup o(f,(x), f(x)), then M(XuU Y) = max(M(X), M(Y)). 
awe 


2. fr&n > fg uniformly if (f,), (gn) are uniformly bounded (i.e. | f,(x)|, |gn(x)| < K 


for all x, n), since 
fe hen = Me 80+ aff 
If (/,), (gn) not uniformly bounded, counter example is 
SAX) = B(x) = x+(1/n) on (—00, 0), 

seiner. 
nt+1— n+1’ 
or, given ¢, |f,(x)| < € on [1—e, 1] and |f,(x)| < (1—¢)" < € on [0, 1—€] for 
n> mM. 

g(x) = 0. Convergence not uniform, for sup |g,(x)—g(x)| > gn(1/n) = 
sin 1 +> 0. 

A(x) = x*. Convergence uniform, for |A,(x)—A(x)| = x*/(1+nx) < 100/n. 


4. f = g = 0. f, has maximum } at (4)". g, has maximum y(n/2e) at (1/2); 
or g,(1/n) = e-!" > et. 


n 
3. f(x) = 0. Convergence uniform, for f, has maximum (4 7 ) 


5. f = 0. In every interval sup /,(x) = 1 for infinitely many x. 


6. Given qo, there is mp) such that all r, with n > m) have denominator > qo; 
then sup|f,(x)—f@)| < 1/qo. 


7. (fr) converges (to 0) on Z; convergence uniform on any bounded subset 
of Z. 
(gn) converges on {0, + 27i, + 477i, ...} U {z|rez < 0}; convergence uniform on 


{0, +271, +47i, ...} U {z/rez < —d} (> 0). 
|sin n(x+iv)| = |sin nx cosh ny+i cos nx sinh ny| 
= y(sin*nx+sinh’ny). 
Hence (h,(z)) diverges if im z + 0, (h,) converges uniformly on {z\im z =0}. 
8. No; take s,(x) = mx/(1+n*x"), Then s, has maximum 1/2 at 1/n. If 
M(6) = sun |f@)| © < 6 < 1), then M(6) + 0 as 6 + 0 and 


poe |G) sn(2)| < max (10. M() <é 


+108 
by choice Ail of . then of n > 1/6. 


9. The partial sums are 1—x", (1—x")(1-x), [1-—(-—x)"—»Ul+x)7. 
Xv,, UWp converge uniformly. 


mt & ealy=a| 
10. f(x, y) = a lin, YS, Y)| = Sir) 
% 3 cosmx]® [%.  cosnx 
il. [ie sin nx dx = ae, + i ¢ @)— — ax. 
2M , M(b—a) 


f(~) =0 and |f,(4)-f)| < 


n 


476 SOLUTIONS OF EXERCISES 


12. Let f, +f. Take ¢ > 0. There exists my such that o(f,(x), f(x)) < € for all 
n> ny and x€ Xo. Take m,n > No. There exists x € X such that 7(/ia(X), Yn) < € 
O( f(x), Yn) < & Hence 


FV ms Yn) S F(Vons ful) + 7 Sn), LD) + FD, ful) + 7 Sn), Yn) < 46. 
Since (Y, o) is complete, lim y, exists. 


5(b) 
1. Sum is x/(1—x*) for 0 < x < 1, 0 for x = 1. Use theorem 5.21. 


2. ‘Only if’: (f,(—1)) diverges and sum function discontinuous at 1. ‘If: 
When [a, b] < (1, 0), sup |f,(x)| = a"/(1+a*") +0; other cases treated simi- 


asasb 


larly. 


3. If ¢(1) + 0, sum function discontinuous at 1. If 4(1) = 0, use method of 
5(a), 8. 


4, (a) n®xe-"™, (b) (—1)"nxe-™ on [0, 1]. 
5. (i) f(x) = 1/x on [1, 7], 0 on (7, &). 


(ii) gn(x) = 1/n on [0, n], 0 on (n, ©); or gp(x) = yon [0, 20). 


ae 
(x—n)?+ 
6. f = 0. If 0 < p < 1, f,(x) increases with x and f,(1) = n/(1+n°); if p > 1, 
f(x) has maximum An'~”) where n°x’(p—1) = 1. Convergence uniform if 
0 < p < 2. Yes, no. 


1. f=f' = 0.f, +f" pointwise on [0, 1], but (f;) does not converge uniformly 
since f/(1/n) = n/4. 


8. f=’ = 0 and |f,—/f| has maximum 1/(2m) at 1/n. f/(0) = 1 for all n. 
9. f(x) =1for0<x<1,xforl<x< 2. sup |nCd—F@)| < 2(2""-1). 
<2< 


5(c) 


. Ecuaed ae BEY 
1. aoe nl +nx*)|— 2n?? 
(M-test). 
(ii) Convergence for x + 0; u.c. for |x| > 6 (>0) and on no larger set since 
sup |cosech nx| = 00 (use theorem 5.31). 
+0 
(iii) Convergence on (—, —2)U[0, 0); uc. on (—c%, —2—d]U [4, 0) and 
3 24 
on no larger set since su 
i reea|(+a)" 
(iv) Convergence for x <0; u.c. for x < —d and not for x <0 since 
sup |e™sin nx| > e~'sin 1. 
r<0 
(v) Convergence for x + 2k7; u.c. on closed interval not including 2k7 
(theorem 5.33), Convergence not uniform on open interval with 27 as end point, 
for when x = 2k7+7/(8n), 


at cos rx a ee NP 
nei Vert Dar Fr r+ tyr 
(vi) Convergence and u.c. on [0, 00) (theorem 5.34). 


uniform convergence (u.c.) on (—©, 0%) 


= 2 and sum discontinuous at 0. 


> Ayn. 
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2. For any n, sup |1/(z*+.7°)| = 00, 
zeZz* 
3. For |x| < 4 use M-test. For } < x < 1, En~? sin nx u.c.; then use theorem 
$.34, For —1 < x < —4series is —Ly"n~ sin n(y+7), where y = —x. 
4. For ze BO; 1)—B(1; 4), 


2 2 


y—zeH 
ee 
~l1—z| é 


Apply theorem 5.33 to the real and imaginary parts of Xa,z". 


1—z 


| 
= (log n)n--8, 


i 


= An-!, sup 


=F sup 2 (n? + n§x?)-1 
"pl +8 


—a<2<0 | 


Use theorem 5.23B., 


6. (i) If 0 < a < 2, u,(x) has maximum An-* where (2—@)n®x® = a; if « > 2, 
u,(x) increases with x and u,(1) = Ge +n*)-!, Thus Lu, is u.c. on [0, 1] igo tn 
2n 


Let 0 <a <1. Then >» jte(d/n) = > 1/(2n*) > 4. and convergence non-uniform 


by theorem 5.31. 

(ii) Consider [1, 00). If 0 < a < 2 and n large enough, u,(x) decreases in 
(1, 0) and w,(1) = (l+n)-. If a > 2, u(x) increases in [1, 00): for a = 2, 
sup u(x) = n-*; for a > 2, sup u,(x) = ©. 


N 
7. x"(1—x) < 1; use theorem 5.33. M,, > [e(n+ Dlog(n+1)]“. 
1 


8. u(x) = (—1)"x"(1 — x). See 5(a), 9. 


9. (i) For u.c. use theorem 5.33. 

(ii) For any x, u(x) = 1/(1+n*) if n is sufficiently large. For any interval /, 
sup u,(x) = 1 for infinitely many n. 
rel 


10. Uniform convergence by M-test. 
x irrational. Each term is continuous at x and so is s. 


x = p/q. 
F (2 + h) = $F fulpiad + nh 
q T ie 


Each series is u.c. (in A) for 0 < A < 1. Each term tends to a limit as h > 0+. 
By 5(a), 12 and theorem 5.21 we can take limits term by term. lim [n(p/q) + nA] 
differ (by 1) if and only if m = qr (r integer). 


11. In [0, a], sin (7x") < 7x" < 7a"; u.c. by M-test. 


1 1 7 
[i sine ae <n [rae = 


o ply. : a 1 © fa 
So Sal = sin (7x") dx converges to /, say. Since f < 4 a jf < /. Thus, 
T Jon 0 Oe dew 0: 
a a 


o oo fa 
by theorem 5.22, 1 f= ii L= é [ <i. 
0 {tae 1 J0 
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a 1 a 
Since [ f increases with a, f f= lim f<il. 
0 0 


a—1-Jo 
N fi 1 N 1 1N N 
Atso & [ -f{ > increases with N and so | ref B=3 [> se 
1 Jo Jo T 0 2) ene 
if N > No. 
« 
2 w, if = 0, 
12. 3 u(x) = {2 : 
Eh F(n) if x = 1Jn. 


Lu, is u.c. on {0, 1, 4, ...} and each u, is continuous at 0. 


13. v,(n) = (") (y’, p(n) =n. 


14. Given ¢, take a = ay < a, < ... < a, = b such that 
\f@)-f&)| <¢ if au <x,x’ <a, (= 1,...,4). 
Ifn > N, say, |f,(a) —f(a)| < € G = 1, ..., k). Let x € [ay-4, a]. Then 
\A(a-)-SO)| < 26, |fnla))—S)| < 26. 

Hence F(X) —2€ < fu@ja) < f(x) +2 

and S(x)—2€ < flay) < f(x) +26. 

Since f;, is monotonic, 
S(x)—2€ < fix) < f(x)+2e. 


Thus, forn > N, sup |f(x)—f(x)| < 2. 
asad 


5(d) 
1. (i) For z + 0, (sin z)/z = 1—z?/3!+... + 1 as z +0, by theorem 5.42. 
(ii) For z+ a, (cos z—cosa)/(z—a) = —2sin (z—a) sin (z+.a)/(z—a) > 
—sin a as z >a, by (i) and by continuity of sine (as sum of power series). 
(iii) (e* —1)/(e?— 1)? + 1 as z > 0. 


2. (i) cos(sin z) = 1—422+424+... (all z). 
(ii) eM9+9 = e(1—z+3z*9-$23+ H4z4+...) (|z| < 1). 
(iii) sin (cos z) = sin 1 cos(—42?+424—...)+cos 1 sin(—4z*++¢z*—...) 


= sin 1—4(cos 1)z*+(z4 cos 1—4 sin 1)z*+... (all z). 


3. For x + 0, f(x) = exp[(1/x)log(1+.x)]. Since f(0) = e, for |x| < 1, f(x) = 
exp (l—4x+4x?—J}x"+...). 1—4x+42?—4)°+.., has derivatives of all orders 
at 0 and so therefore has f. For small |x|, f(x) = e(1—4x+4}x?—yex5+...). 
Thus f” (0) = —4ze. 


4. (i) Za, x", Bb, x", Zc,.x" have radii of convergence > 1. Then (La,x")(Zb,x") = 
Xe,x" for |x| < 1. Let x + 1— and use theorem 5.47. 
(ii) If an = by, = (—1)"*4/J(n +1), then |c,| > 1. 
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5. (i) Da,x" is u.c. for 0 < x < 1. Hence f (Za, x")dx = = i a,x" dx. 

(ii) Za,x"4/(n+ 1) has radius of eenverente > 1 and so ag Za,x". Hence, 
for 0<£<1, feaxae = La,£"/(n+1) > Za,/(n+1) as E>1-, by 
theorem 5.47. ‘ 


Sz tif nde 1 f}/ x+/2 x-/2 ) 
6. By 5, sum of series is [ “o- of (se, 32x41 dx, 


7. Coefficient of x": 
—1¢— 1)yr-rtl (— yr —1)rn-l 1 1) -1)" 
"SiC Ars (yee ms. ( +1) =( ) 


Bonny 
fel nF r ho ya =r T, n 


Valid for x = 1 as 5,_,/n decreases and tends to 0. 


8.220: z||( ) converges, by 4(f), 2. Hence, by M-test, = (*) x" is u.c. for 
-—1 <x <1; the sum is (1+x)* for -1 < x <1 and, by continuity, for 
x=tl1. 

@>--1:25 (") x" converges, by 4(f), 2. = (*) x" is u.c. in [0, 1] by theorem 
5.34 and in [—1+6, 0] by M-test. 


9. By 8, ihe n.. converges uniformly to (1 +x)-t for 0 < x* < 1, 


ice. |x| < 1, Integrate. 


a 
n 


10. put (*)/ B ) Se Forde cea = 5 (*) xz (Ae = (14x), 
0 \r)/\n—r n n 
By theorem 5.43, c, = eee - 


5(e) 
1. If f is a continuous nowhere differentiable function on [a, 5], define g, 
(kK = 1, 2, ...) on [a, 6] by 


cd r 
een = [ MO) dt, gy(x) = [ seiltdt (k= 2,304). 


Then g® = fand so g, is the desired function. 


2. Since Zu,/n® is u.c., the sum g is continuous in [0, 1]—{r1, rs, ...}5 at rn the 
left and right limits exist, but are unequal. Each u, is integrable and so is g. If 


ec 
A(x) = j g, h is continuous everywhere, but is not differentiable at r,, for the 
0 
ey 
left and right derivatives differ. Finally, f(x) = A(x)+ Yra/n*. 
1 
3. Take f(x) = 1/x forO< x < 1. 


4. F< BO;r), say. Take R > r, Fy = R'—B(O; R), F, = FU Fo. Let f, be the 
extension of f to F; with f,(x) = 0 for x € Fy. Apply theorem 5.52 to /,. 
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5. Given €, choose 6 so that o(/(x), f(x’)) < € when x, x’ € E and p(x, x’) < 6. 
If x, x’ E and p(x, £) < 40, p(x’, €) < 46, then o( f(x), f(x’) < €. By exercise 
3(d)1, Tiny) exists; define f*() to be this. 


—E 
Let in u’ € E be such that p(u, u’) < 40. There are x, x’ € E such that 
Px, x) < 8, o(f*W),f*)) <6, o(f*W),f*(%)) < € 
Then o(f*(u), f*(u’)) < 3e. 


5(/) 
1. |f(x)| < M, say, for a < x < b. Take € > 0. There exists a polynomial p 
such that |f(x)—p(x)| < ¢ fora < x < b. Then 


[r= [1u-n+ [m= [’r0-1) < 6-2 


» 
Hence [ f*= 0: 
la 
If f = 0, ners exists £e€[a,6] such that f(£) = 9 + 0. By continuity, 
S*(x) > 4n* for a < x < f, say. Then 
[re [ir ea > 0. 
la a 


2. The set A of trigonometric polynomials is an algebra in C[x, £] which con- 
tains the constant functions, If #—a < 27, A separates points for, when 
0 < |x,;—x,| < 27, at least one of cos x,—cos x2, sin x,—sin x, is not 0. If 
—« > 2n, clearly A does not separate points. Then only continuous functions 
with period 27 can be approximated. 


3. The even polynomials on [a, 5] separate points if and only if [a, 5] < (—20, 0] 
or [a, 6] < [0, 20), 


4. For each x, y,(x) >y(x), where (x) = d{y%(x)+1—x*}. By first part, 


(x) = 1—|x|. Convergence uniform by theorem 5.35. y, is a polynomial 
(of degree 2"), 


6 (a) 
1. Consider 9’ with one point of division added to those of Z. 
2. When k > 0, S@, kf, g) = kS(@,f, g) and S(D, —f,g) = —s(Q, f, g). 


3. S(D,f, 81482) = SD, f, £:)+ SQ, f, 82) and D may be chosen so that all 
three sums lie within € of the corresponding upper integrals. 


4. Follows from 3, 
5. SD, fy, 8) < SQ, fy 8). 
6. f(x) = 1 for x rational, —1 for x irrational. 


7. For x rational, f(x) = 1, h(x) = 0; for x irrational, f(x) = 0, h(x) = 
g(b) > g(a). 
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8. If m, M are the infimum and supremum of f on [a,6], then 
mh(x) < f(x)h(x) < Mh(x) for a < x < band so 
b b > 
m | hdg </ Shag < m{ hdg. 
a la a 


9. Given ¢, there is 6 such that |f(u)—f(v)| < ¢ if u,v e[a, 6] and |u—v| < 4. 
When (2) < 6, S(D)—s(Z) < e(g(b)—gla)} and 


b 
9) < [fae < Se), 
10. (i) |F(v)— Fw)| < K{g(v)—g(u)}, where K is the supremum of |/| in [a,4]. 
(ii) If m(u, v), M(u, v) are the infimum and supremum of fin [x, v], 


g@)—8W) — FO-FW < yy, yFO=8) | 
v-u v-u v-u 


m(u, v) 


11. There is a dissection 2’ of [a+e, b], say até = xX,< <1... < X= 
such that S(D’)—s(B’) < ¢. If D is the dissection a = xX) < x1 < ... <%= b 
of [a, 6], then S(P)—s(Z) < (M—m)e+e¢, where m, M are the infimum and 
supremum of f on [a, 4). 


12. Let c be a common right discontinuity. Any Z has points x,., x; such 
that x;_, < c < x, Then 


S(D)—(D) > (Mi—m)g)-8(xi-a)} > \f(e+)-FO|{g(c+)—8O} > 0. 
13. For n > N, say, |f,(x)—f(x)| < € (a < x < 6). Thus 


Fb b » » 
5 fée—{" fdg < f Uw+6) de— f (fv-0) de = 24(g(6)—g(a)}. 


b hb 
aoitor n= n, f fda i fut < e(g(6)-g(@)}. 


14. If f(x) # 0, let sup f(x) = M > 0. There is an interval [«, 4] in which 
Sf) > M-e«. Hens 

M"{g(b)— g(a} > [rae 2 [irae > (M—€)"{g(f)—g(@)} 
and, for n sufficiently large, 


{g(b)—g(@y" < 1 +6, {e(8)—g(@}" > 1-«. 


6 (5) 
ze 0 (x = 0), 
sa 1 1 1 1 (un 2 0), 
rl (1-— 1-—_), --)= 2 
g(x) = ae (: pies wai) i() = He (u» < 0), 


3 |u| (& = 1); 
r=1 


ae ¥ 1 it 
Ii hi i oy ecomes =0. 
also / is linear in each interval [1 ey 1 al and f(1) = 0. 
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3. gn(x) = x" on [0, 1], f monotonic on [0, 1] and discontinuous at 1. 


4. f,g, have no common left or right discontinuities and nor have f, g, by 
uniform convergence. Thus fe R(g; a,b). Then use integration by parts and 
exercise 6(a), 13. 


6(c) 
1. Necessity obvious. To prove sufficiency adapt the proof of the completeness 
of R* given in $4.2 (p. 81); or use the completeness of R! as follows. The 


sequence ae 
= f fag w= 1,2, 0.) 
la 


Xx 
converges. Also fdg>0 as X¥>om. 
(x) 


2. Use theorem 6.31; or write f = (|f|+/)—|/| and note that [asitnae 
a 

exists, since 0 < |f(x)| +(x) < 2|f(x)|. 

3. Integrate by parts. 


4. To prove convergence use integration by parts. Also 


in+¥™| cos x 1 ae 
——— 2 cos x| dx > ————,, 
‘bers x+sin x (n-9)7 Jn-yn | (n-2)n 
(nt 1)*4=n® — @ fal) 1 
5. ieee =z r Postage! 


: 5 a+1 ri 
as n - 00, since the power series = ( : ) x" has radius of convergence 1 and 


is therefore continuous at 0. 
(i) Let a > 0. Since f(n+1) < f(x) < f(n) for n < x < n+1, 


(n+ 1)*41 =n (n+ 1)*4— 724 
a+1 a+1 
and so, for n > N, say 


Unt 1*f(nt1) < 4n*f(nt1) < f mth ap(xyde < 2n*fln). 
n 


f(n) 


S(ntl) < PP ereoas < 


(XI) x. x) 
For X¥ > N, 43 nf) <{ xf(x)dx < 23) n*f(n). 
NF1 N N 
(ii) If @ < 0, x*f(x) decreases and (i) may be applied to x°(x%f(x)). 
b 
6. Let f(x) > 0. f ; fdg is bounded and increases as A decreases and so 
a+ 
lim [ Sag exists. In general, write f = (|f|+/)—|f]. 
h0+ Jath 


If fe R(g; a, 6) and g is discontinuous at a, then f is continuous at a. Thus 


ath 
[2 fae > Hateta+)—e(a) a5 b> 0+. 
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4s 2 log x 2 ( lig log x ) 
dx = | li dx) = 0. 
Siaeris xe lords GDF 


8. 0<a+1<fandf<a+1<0., 


9, By the M-test, there is uniform convergence on [«, /] and so, by theorem 5.22 
(or exercise 6(a), cn 
B 0-1 
5 te log (1/x) dx = is x°7 Tog (1/x) 4. 
n=0 ae 1-x 
Applying the “pig of theorem 6.33 we first get 
1 
2 Pies log (1/x) dx = ii ete OED oy 


and then : 
= 1 = < x7 log (1/2) 7, 
- m+om1 = 
Save 3, [vt meaine lame 


<0 
10. On (0, Y], e-”” < e-7¥. Also sup f e-*v dx = sup ye-*"” = 0, 
y>0 JX y>o0 


a: ‘ig y Ae L; a AN i i€ ea yp he 
and consider each term. 
12. (ii) oe pf. o- 5- arc tan Xe. 
(iii) ba Ie i 5 
6 (a) 


1. If |f')| < K fora <x <banda<s<t<b, |f(t)-f(9| < K(t-s). 
2 | AO|=|F09| | < |FO—F()|. If |f@0)], |g@)| < K in [a, 5}, then 
\fOsO—fe9| = |fOEO-8O}+eOSO-LO}| 
<Ki|f(N-f(9)| + le-g)}- 
3. P(D,f)+WPD,f) = VBS), PDS/)- WS) = fO)-L@; 
PD, f) = HV DA/+/O)-f@}, WD) = KVAN-Lb)+f/@}; 
Pf) =HVAN+LO)-f@}, OS) = HVAN-fO+f@}. 


b 

4. For any 2, V(Q, F) < [ \f|dg. Take 9’ so that S(D’, f, )-(D", f, g) < & 
la 

For each i, there are A;, “; such that 


 fdg = Adg(xd—e(xi-Dh 


Li—1 


[Wei = iets a0. 
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‘Then 0 < mai < M;—m; and so 
is de 3) |" sae] < 3 (ot, foCed ea) <6 
d=1| Jai i=1 . 
Thus rH) > 1@',F)> | Iflde-e 
For the last part, use 3. ss 
(x = 0), 0 @O<x<I/n, 


0 
5. f(x) = | Silx) = | 


x cos (7/2x) (0< x < 1); f(x) (jn < x <1). 


6(e) 
az 
1. By exercises 6(d), 3, 4, G is of bounded variation and p¢(x) -[ gt, 
la 


ae 
I(x) = 1 g~. Hence, by theorem 6.21B, fe R(pe; a, 6) N R(gg; a, 6) and 
la 


[sere = fan Pate = fe 


2. Since s(Q, f, p,) < AEM Dol) — Pola) < S@,f, p,), by exercise 6(a), 9, 
TSE Po(x) — Po(Xi-1)} > f Sdp, as WD) +0. Replace p, by g, and subtract. 
a 


3. For every n, f, € R(p,; a, 6) N R(q,; a, 6). Now use exercise 6(a), 13. 


z) 
4. Choose f,g so that [ fdg #0, ge(b)—g(a)=0; eg. f(x) = cos x, 
a 
g(x) = sin x on [0, 7]. 


5. Let |g(x)| < Kforx > aandlet0 < f(x) < ¢forx > X. By exercise 6(a), 12, 
f and p,, f and q, have no common left or right discontinuities. Hence, by 
theorem 6.54, if X¥, > X, > X, 


Xs Xa 
ie fue = fOxDe)=fODED- |” ea < 3Ke, 


r+1)m sin? 
7. (ii) ig [sa d(cos x) = = ie nef" sine ge =" "S(-0 and 
=(—1)'+4u, converges by the teminting series test. a for 0 e a<m7, 


ee 
6(f/) 


1. We need only consider the cases where f*(x) and f*,,(x) are defined by 
different formulae. For instance let f,*(x) = f,(x), so that |f,(x)—An(x)| < K. 


Tf ft) = Mnys(x) + K, 
SE CI—LEC) > Cng@) + K)= Cin) + K) = nal) — hn) > 0. 
Tf fi.1(X) = Anyi(X)—K, so that frji(x)—Anualx) < —K, 
Siti C—f) > fist) —fulx) > 


sin x ueaa\< 
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b +8 b 
2. Necessity. (i) gives $(b)—¢(a) = 0. (ii) [ Su,gd¢ = [+ i + ( = 0, 


e+ 8 b 
f < vit*(); [ =0. 
co +8 


Since ¢ is continuous at x, V2t%(¢)+0 as d+0 (theorem 6.44) and so 
9(x)— $(a) = 0. ; 

Sufficiency. Take ¢ > 0. By exercise 6(e), 2, there is 6 such that, for any dis- 
section D: a = x9 < X1 < «1 < Xn < Xn = b with MDZ) < 4, 


[= 9-8@ 


b 
ir) {9 — $041} - ; rae) <6 tes) 


But, since ¢ has only countably many discontinuities, x, ..., Xn. can be chosen 


b 

to be points of continuity of ¢, so that the sum in (*) is 0. Thus If tf al me, 
a 
= g* 

3. g = g*+¢, where pees 


0 for a 
e<x<b 


< 
1 for ¢< 


g*) = { 


and ¢ is a function of the kind described in 2. Note that ¢ may be chosen so that 


0 for a<x<e, 
1 for c<x<b. 


a(x) = 


6(g) 


1. Follow the proof of theorem 6.71 with two changes, 
(i) In the notation of that proof, 


0 < SD)-SD) < (M—m){g()—g(%i-)}- 


(ii) Since g is uniformly continuous, we may choose 6 so that, if0 < v—u < 4, 
then 0 < g(v)—g(u) < €/no. It follows that 


0 < S(D3)—S(D*) < (M—m)n((E/no) = «(M—m). 


2. On [—1, 1] let 
1 for -1<x<0O, 


I= \o for O0<x<1il; 


0 for -1<x<0O, 
<1 


a(x) = | 


1 for O0<x 2 
If 0 is a point of division of 2, S(D, f, g) = 0; otherwise S(Z, f, g) = 1. 


3. Adapt the proof of theorem 6.71. If Z’ is obtained from Z by adding new 
points of division in the subinterval [x;_,, x] of Z, then 


0< ViQ)-VA”< Veh): 


Choose DY, so that V(D_, f) > V?(f)—«. Let mo be the number of subintervals 
of Z,. Since v; is continuous (theorem 6.44), there is 3 such that V?(f) < €/no 


« 
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if 0 < v—u < 6. Let B; be a dissection with “(D3) < 4 and let Z* be the dis- 
section with all points of division of 2, and Z;. Then 


0 < ViD*, f)—V(Bp,f) < no(Elno) = € 
andso Vi(f) > ViDs,f) = ViG*,f)—€ = ViDo, f)—€ = Vilf)—2. 
Similarly, if V(@,f) is unbounded, V(@5, f) > 0 as 8 + 0, 


4. On [—1, 1] let f(x) = 0 if x + 0, £() = 1. If 0 is a point of division of 2, 
then V(Q,f) = 2; otherwise V(Z,f) = 0. 


6. For any dissection of [a, 6], 
S fovea 3 sdfes)-f0.-0) = f0- af. 
If f(x,) = t,, this can be written 
z SL Qe=1) = X1-) + PO) (ti- tia) = bB—aa. 


Since f is uniformly continuous, max (t;—¢;-;) >0 as max (x;—x;-;) > 0. 
Use theorem 6.72(i). 


6(h) 
1. [a, 6] may be divided into a finite number of subintervals [a;, 5,] such that f 


is continuous in [a,, b,] except at one of the end points. Use exercise 6(a), 11, 
theorems 6.12, 6.16. 


3. Let &,, ..., $: be the limit points of E. Outside U(&,—e, &+¢) there is only 
a finite number of points of £. These may be covered by intervals of total length 
less than e, Hence E may be covered by intervals of total length less than (/+ 1)e. 


4. By 3, c(E"-») = 0. The proof of 3 is easily adapted to show that, if D is 
bounded and c(D”) = 0, then c(D) = 0. Hence c(E"-*) = ... = c(E) = 0. 
5. Let [a, b] > E,U E,. Since wz, Xz, are integrable over [a, 4], so are 

Xe,ug, = (xe, + Xz,)+ |Xe,—Xz,|} Xen e, = H(xe, + Xe.) — |Xz,—Xz,|}- 
Also XB, UE, +XE,nE, = XE, + XE 
6. By 5, 0 < c(E, UE.) < c(E,)+c(E,) = 0. By induction, c(Z,U...U £,) = 0. 


For the second part, let r,,7r2,... be the rational numbers in [a, b] and put 
En = {a}. 


7. h(x) = f(x)—g(x) = 0 except in a set of zero content. Thus (see theorem 


7 
6.83) | A exists and is 0, Hence 
a 


es NN od a ce 


8. If E = {1, 4, 4, ...}, c(E) = 0; and, if fis assigned any bounded set of values 
on E, then fis bounded on [0, 1] and continuous on [0, 1]—£. 
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9. Let 


1/q_ if x = p/q, where p,q are coprime and 1 < q <n, 
Six) = i 
0 otherwise. 


then f, >/ uniformly on [a, 6] and each /, is integrable since f,(x) = 0 except 
at a finite number of points. 


10. Take ¢ > 0. Choose @ so that 
£ fine < (B.S) < (Bf) < [ ” Pte. 
Since O)-f@) = ESE N= Kea) Cer < Ee <0, 
APS’) < $(0)=f(a) < SG,f. 
6)-fa)- [7 <6 
11. f is not differentiable at 0, since {f(h)—f(0)}/h = sin (log A) oscillates as 


h>0+. For 0< x <1, f(x) = sin (log x)+cos (log x); so f’ is bounded 
and continuous on (0, 1], therefore integrable over [0, 1]. Also fis continuous on 


[0, 1] and so, by theorem 6.84, f f' = f(Y-fO) = 0. 


Hence 


12. {f(4)-—fO}/A = Asin (7/2h*) > 0 ash>0+.For0<x <1, 
f(x) = 2x sin (77/2x*)—a(1/x) cos (7/2x*). 
Thus f’ is not bounded on [0, 1]. But 


1 
i Sf’ = f()—f) = 1-4" sin (7/26) +1 as 6+0+. 
13. Let f’ = g = g+—g-. Then g, g*, g~ are continuous and 


f)-S@ = [fe = [e-[e = $(x)- Wr). 


6@ 
1. a, be[e, d]. Define F on [c, d], G on [«, £] by F(x) = ne: G = Fo¢. Then 
a 

justify the following steps: 

2B B > 

[i veme = ['e = c)-G@ = FH-Fe = fs 

a a a 

2. Assume 0 < a < b. When 0 < é < X, by theorem 6.92 (or 1) and exercise 


6(a), 8, 


X f(ax)—f(bx) , _ (°F) Mees dae a 5 
: LOD ag = [MIE a |" O dt = Ay—Ax) log’, 


where A;, Ax lie between the infimum and supremum of fin [ad, 66] and [aX, bX] 
respectively. 
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3. In the first part f is decreasing. Define f* by f*(a) = f(a+), f*(x) =f) 
for a < x < b. Then f* is decreasing and, by theorems 6.83, 6.93 (i), 


[iw = [ire =rofe =fat){ 


h 
4. Adapt the proof of theorem 6.93 (i): begin by considering f fd(g+v,), 
la 


which has an increasing integrator. 
For the last part take ‘on [a, b] to be continuous and decreasing with f(a) = 2, 


b ‘4 

f(b) = 1; g(x) = 0 for a < x < bg(b) = 1. Then { fdg = tana fla) [ dg=0 
a a 

fora <§<b,2forg =b. 


5. Let 


0 
) fi | < K. If g decreases, then g(x) > 0 and 
a 


fe 


6. If g decreases and |g(x)| < K, then g(x)+ K > 0 and 


i 
< 2x\f tf 
x 


7. & < 0. (2/m)x* < sin(x*) < x* (x > 1); use comparison principle. 


x ee 
a>0o f sin (x*)dx =[ ué sin udu, where B = (1/#)—1. Since X* > 00 
1 1 


i 
= lecxo f f < 2K|e(X)|>0 as X,>0. 


+0 as X,>%, 


firern 


é 
™ teoroens | f 


0 0 
as X >a, J sin(x*)dx exists if and only if i; uv sin udu exists. When 
if 1 


O<a <1, f2>0 and aia sin udu > 2. When « > 1,  < 0 and the 
second mean value theorem (or 5) gives convergence. 

8. (b) Use (a) and the fact that x/(x+ 1) is bounded and monotonic. 

10. For y > 0, 


‘Xe 
If e~ sin (x/y) dx 
ix 


E 
ene sin(xi)ds| < Qye* < 2X7 1e47 


T(a) 


tit |Dif,C)| < M for xe B(E; 6). With the notation of thoerem 7.14, if 
jal < 8, ‘6 
\fE+h-LO)| < >>) |\fE+kK)-LE+K™)| 


< 3 |nlM < mMjal 
i=1 


and 20 “|fE+) =f] < nmM ji. 


3. Let |u|) = 1. |fE+t)—fE)— Df/O(tw)|/|tul] + 0 as t+ 0. Since |tu\| =|¢] 
and Df(é)(tu) = tDf(E)(u), this implies {fE+m)—/(H}/t + DFOHW). 
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4, By theorem 2.21, |Df((u)| = (Vf()".u < | VFO] whenever jul) = 1, 
and equality holds if and only if u = uo Now |Df(E)(uo)| mais |DFEW| 
llull=1 


=| D/E)||. Use 3. 


5. Let u?+v? = 1. Since {f(tu, tv)—f(0, 0)}/t = uv, Diu,» f(0, 0) exists, Also 
|f(tu, tv)— (0, 0)| = |u*vt| < |t| and so fis continuous at (0, 0)7. 
Iffis differentiable at (0, 0)”, then, since D,f(0,0) = Df (0,0) = 0, Df(0, 0) = ©, 


Bee Iu, te)—f(0, 0)—O(tu, 1)|/|¢| = |uto|- 0 as 10. 


6. Since f(w, 0) = f(0, w) = 0 for all w, D,f(0, 0), D,f(0, 0) exist and are 0. 
But, when w + 0, D,f(O, w), Dz f(w, 0) do not exist. / is differentiable at (0, 0)”, 


since fh, HF, 0)—O(h, )| = kl < 40+ k) = 3h, AIP. 
7. If A, #4, v are linear functions on R” to R", R’, R"*” such that v(A) = 
(A), 70))?, then 

|fE+N-(O-vA|? = |PE+-4O-AM|*+ |YE+H-YO- “OHI. 


. D,f(a, b) = $'(@yb), Dafa, ) = $a") 


and f(ath, b+k)—f(a, b)—hD, f(a, 6)—kD. f(a, b) 
={p(a+h)— 9(a)(b+k) + (b+ k)— YO) $@) 
— hd’ (ayy) — koa) 
= thd’(a) + o(\h|) +k) + {kb + o(|k|)}0(@) 
hd (afb) — kplayy() 
=o(|\(4, )|)), since yb+k)—¥() = 01), ¥(b+k) = OU). 
9, If g: R! > R'is a continuous, nowhere differentiable function (theorem 5.51), 
define f: R? > R! by f(x, y) = g(x) for all (x, y)” € R*. 
10. Df; (i = 1,237 = 1,2, 3) is clearly continuous everywhere. Hence / is 
everywhere differentiable. Also 
| D/C, »(h, Kl) = (2 +k? sin2x)t < |\(A, Kl for all (4, k)? € R® 
and | DFG, yh, O)|| = |h| = II, 


7(b) 
1. Let g:.R" > R be given by g(x) = |x| = VQi+...+2%). Dig, .. Dag 
exist and are continuous except at 0. Hence g is differentiable except at 0 and 
||| = go fis differentiable at £ if D/(E) exists and f(E) + 0. 


2. |f|2=S.f is differentiable by theorem 7.21. If ||f|* is constant, 
© = Dif \*@) = 2fE). D/E). 


3. (i) For fixed t>0 define ~: XR? by (x) = g(tx) = f%g(x). Then 
Dix) = tDig(tx) = t*Dig(x), so that Dig(tx) = t°* Dig). 

(ii) For fixed x € X define ¢ : (0, 00) > R® by A(t) = g(tx). 

If f: (0, 00) > R” is defined by f(t) = tx, then ¢ = gof and, by theorem 7.22 
(see note), $(t) = Def@))F'M) = Dg@x)(). 
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Necessity. $(t) = t%g(x) and so at*1g(x) = $'(t) = Dg(tx)(x). Put 1 = 1. 

Sufficiency. 19'(t) = tDg(tx(x) = De(tx\(tx) = ag(tx) = a6(t). Thus, for 
t > 0, (d/dt)(t-*4(t)) = @, i.e. t-*(t) = C. Since t = 1 gives C = 4(1) = g(x), 
a(tx) = P(t) = t%g(x). 
4. (fopy(r, 6) = (7 cos 4, r'# sin 4)” and soJ(fop\(r, #) = (1—a)r'*, Since 
also Jp(r, #) = r and 

J(fop\(r, ¢) = Jf(r cos ¥, r sin ¢)Jp(r, 9), 

If(&%, Y) = If(r cos 4, r sin ) = (1—a)r-**, 
5. If f(x) = On Ya, Ys)", 


Vat: Me 
HNtMty % = a 


Vtyatys’ “ YotYs 
provided that y,+y.+¥s + 0, y2+¥s + 0. Hence 
Y= (On Yo Ya)" |ityat Ys +0, YotYs + 0}. 


f-: Y > R'is differentiable, since all partial derivatives exist and are continuous 
on Y. If x = f(y), 


IF) = WIS) = UGGx2) = 101+ 2+ ¥DO2+Ya)]- 


To) 

1. Let h = v—u and define $:[0,1]> R' by (rt) = f(u+th) (0 <1 < 1). 
Then ¢ is continuous at 0, 1 and differentiable in (0, 1) with (¢) = D/f(u+ th)(h). 
Apply mean value theorem to ¢. 
2. If v = ut+2z, fv)—f(u) = 4. But, for all £ € R', 

|DFE)\2m)|| = ||\(—27 sin £, 27 cos £)"|| = 27. 
3. Let A = f(v)—f(u)— Df(u)(v—u). Nothing to prove if A = 0. If A + @, 
let w be unit vector such that ||Al| = .{f(v)—f(u)— Df(u)(v—u)}. As in proof 
of theorem 7.31, there exists 7 in (0, 1) such that w.{/(v)—f(u)} = w. Df(ut+Th)(h), 
where h = v—u and so aren Then ||Al| = jo. {Df(ut+7h)(h)— DfW}|| 
< |Dfutrh)— Df(u)| |All. 
4. Let p(K, G) = 26(>0). If H = A LB, 6), then H is a compact subset of G. 


Thus f, Df are uniformly cantinnons on A. (i) Now immediate. For (ii), if 
x€Kand |h|| < 6, by 3, 


If Ge+A)—f0)— DFA) Al] < AEP (DL09- Pool. 


5. Each sequence (D,f}) converges uniformly on every compact subset of G, 
since 
ID: f'C)— DiFZ@)| < |Df4@)— Df") |. 


Suppose (f”(€)) converges. If x is any point of G other than &, £ and x may 
be joined by a polygonal path in G with segments parallel to the axes. Integrating 
the continuous functions D,f? along these segments we find (theorem 5.22) 
that each sequence (f}(x)) converges and so (f”(x)) converges. The same argu- 
ment shows that the convergence is uniform in every closed ball in G. 
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Let K be any compact subset of G and put p(K, G’) = 26 (>0). By the 
Heine-Borel theorem, there are finitely many open balls B(x"; 5) which cover 
K. (f”) converges uniformly on each B(x"; 6) and so on K. 

Take x € G. Theorem 5.23 (A or B) applied to straight line segments through 
x parallel to the axes shows that the D,f,(x) exist and equal lim D, f}(x). 
Since the D, f? are continuous, so are the D, f;, Hence fis continuously differen- 


table. Since | pf(x)— Df")? < ZIDSG)— Defers, 


Df"(x) > Df). 
7@) 


1. (i) When m =n =1, existence of Dwf(E, 7) equivalent to existence of 
Df(E, 9) G@ = 1, 2) and this does not even imply continuity. 

(ii) All partial derivatives exist in the open ball (see p. 215) and are con- 
tinuous at (£, 7)” (as on p. 211). Apply theorem 7.14. 


2. Dif(x, y) = x+y > 0 for all x,y > 0 
Dif(x,y) = y-x2 =0ey=xt; f(x,x7) =0ex=e, If solution 
through (e#, e#)” is y = $(x), 
$(x)— xt 


9O = 3 GO 
Since ¢(et) = e+ and ¢’(e#) = 0, (et) = —4e-#. 


3. Let & + 0. By the mean value theorem, /(E+y)—f(y) = &f(y+a8), where 
O<a<1. As y>+ito, Ef(yt+at)> +o or Fo according as £20. In 
either case there is an 7 such that f(§+7)—f() = f(é). 
If F(x, ») = f(x+y»)-S@)—-S0), DFE, 1) = f'E+1-S'M) + 0, since § + 0. 
Last part: f(x) = 1+2x*. 


4. E.g. (a, 0, 0)7, (0, a, 0)? when a + 0. 
5. Jf (x, ¥, z) = 3xy* and £(, y, z), (x, 0, z) cannot be 4. 
“C4249 
+ -4 o)° 
7. E.g. when u,v, w < —1. Jig) = 1+ etotrot > 0, 
-x ye" —zertw 
me - xewtu -y ze’ 
1 + ettetw % 
xe“ —yerr =z 

8. E.g. (x, 0,0,v)” satisfies the equations if g(v) = v—sin(cos v) = 0; and 


2(0) < 0, g(v) +m asv>+a, 
J = —e“cosv +0, for cosev=0>x=0>v=0., 


Te) 
1. Counter-example: In R}, f(x) = x*, § = 0. 
If the local inverse ¢ is differentiable, 


I= D(pof)(§) = Do f(E))o DfE) 
and so 1 = J9(f(@)).JF@). 
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2. Jf(x, y) = sin(y—x). For all 4, 0’, 
S(@+6, e+ 2nT +4) = f(a+5’, a+ 2n7+6), 
S(at+6, e+ (2nt1)7+8) = (, 0)7. 


‘ —x* xy zx 
= -y yz |. 
Dayz xy oe 


2x yz —2*, 
4. (1+x%+y%). 


7. Counter example: if f: R* > R® is given by 


S(x, ») = (e*cos y, e*sin y)?, 
then f(R*) = R*— {0}. 


1A 
1. Jacobian x* sin y. 
2. If Y: R?> R' is given by ¥(u, v) = 2e""—ut+v, YUf(x, y), g(x, »)) = 0. 
Also, on all open sets, ‘Y + 0; for, given u, ‘(u, v) strictly increases with v. 


3. The origin in R® satisfies the equations and Jig) = 27u*v*w*+1 > 0. Hence 
there exists [—«, «]*x[—/, 4]* in which there is a unique solution. Also 


6(y—z)(z—x)(x—y) 


27u*v*w? +1 ily 


J¢=—- 
in (—a, «)%, 


4. If {(G) has no interior point, define ¥ : R" > R' by Y’(y) = 0 for ye /(G), 
¥(y) = 1 for y ¢f(@). 

If f(G) has an interior point, then, whenever ¥'(/(x)) = 0 for xe G, ¥(y) = 0 
in an open set containing that point. 


5. In the definition of functional dependence we may clearly replace the con- 
dition ¥Y + 0 in any open set by (C): ‘Y + 0 in any open set containing a point 
of f(G). Then (C) <> for all y € f(G), y is not an interior point of {z|‘Y(z) = 0} 
for all ye f(G), y € support of ‘YY </(G) < support of VY’. 


6. Let ¥ be as in the definition of functional dependence of f,, ..., f,. Define 
* from R"*+! to R' by 


Lay vee Yn» Ynga) = POs «+s Inds 


Then ‘’* + 0 in any open set in R"*+, since otherwise ‘’ = 0 in an open subset 
of R". Clearly ¥'*(f,(x), ..., f(x), g(x)) = 0 for xe G. 


7. If g(x) = P(f,(x), ..., fa(x)) for x € G, define ‘¥ from R" to R* by 


Ly oes Yn Png) = Oy «+9 Yn) —Yntre 
Then {y|'¥(y) = 0} has no interior point; for if Y(), ..-» Yn Yni1) = 0, then 
Way «0s Yas Yass) + O when Yiar + Yaar 
8. f(R’) = {0, OT} U (7, +2*sin t+)? |t > 0} and this set clearly has no interior 
point. 
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fris not functionally dependent on f;, for (x?) is even (all ©), while x*sin (1/x) 
is odd. 

fy is not functionally dependent on /;, for (x4 sin (1/x)) has the same value 
for x = 1/(nm) (n = +1, +2,...), but x? has not. 


9. Take ® = gof. 
10. h = 2f?+g%)'cos[f+ (2 +8")'}. 
ll. A = 43/fe-f*). 


7(g) 
1. D,f @ = 1,...,m) exists. The real function ¢, defined by ¢,(t) = 
fi ty Say ose mn) has a maximum or minimum at £ and so D,f(€) = 9\(6,) = 0. 
Also D,f(é) = 0 (i = 2, ...,m) and so Df(é) = 9. 


2. Since G is compact, f assumes its bounds (say k, K) on G. If fis constant in 
G, then Df(x) = © for all x eG, If fis not constant, k + K and f assumes at 
least one of k, K in G. At such a point f has a maximum or minimum. 


3. (x+y, x+2y) = (0,0) > x = y =O > x*+xy+y? + 1 
By theorem 7.71, critical points +(1, 1)”, + (1/V3, 1/-/3)7. 
Largest value 1, least value 1/3. 


4. (2x, 2y, 2z) + (O, 0, 0) if x*+y*+z* = 2, Lagrange multiplier A such that 
A(x+y+z)=0. A=0_ gives critical points + (¥(2/3), V(2/3), (2/3))*. 
x+ty+z = 0 gives +(0, 1, —1)7, +(-1,0, 1)", +(1, —1, 0)". Largest value 2, 
least value — 2. 


5. Theorem 7.71 applicable. Lagrange equations 
2x—y—z+A(2x—2) = 0, 
2y—z—x+A(2y+2) = 0, 
2z—x—y+A(2z+6) = 0 


yield A(x+y+z+3) =O0.A=O0>x=y= z33x*+6x+9 > O.xty+z= —3 
leads to 


pas rast Bey cae) 
Spee a AES: 
Substitution in condition givesA = —% or }. Hence critical points (2, —1, —4)7, 


(0, —1, — 2)". Former gives supremum, therefore maximum; latter gives infimum, 
therefore minimum. 


6. Box has length x, width y, height z. 

(i) Consider V = xyz under constraint 2yz+zx+xy) = a*, x,y,z 20, 
(yt+z,z+x, x+y) + (0, 0, 0) if x,y,z > 0. Critical point x = y = z = a/y6. 

V = 0 when one of x, y, z = 0. Also xy < 2a*, xz < 2a* and so V < a‘/(4x). 
Thus V is small if x (or y, or z) is large. Hence sup V exists and is attained at 
, 1, O%, where &, 7, ¢ > 0 and 2(7¢++£n) = a®. So (E, 7, 0)" is the critical 
point £ = 7 = ¢ = a/y6. 

(ii) V under constraint 2yz+2zx+xy =a*, x,y,z 2 0. §= 7 = a/V3, 
= a/(2y3). 
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7. Rank of i 2y i 
pie a 


is 2 unless x = y = z, and x = y = z does not satisfy conditions. Critical points 
(1, 0, 0)”, (—4, 3, 3)”. Largest value 1, least value §. 


8. (i) Stationary points + (,/2, /2, /2)", both in E = {(x, y, z)"|x*+y2+z? < 9}. 
(ii) (2x, 2y, 2z) has rank 1 when x*+)?+z*?= 9, Lagrange’s equations 
2—yz+2Ax = 0, etc. Subtract in pairs: 


(y—z)(x+2A) = 0, (z—x)(y+2A) = 0, (w—y)(zt2A) = 0. 


Then x= y=z= +3 or y=z= —2A, x = (2A?-1)/A, etc. By sub- 
stitution in constraint, A? = 1 or 1/12. Hence critical points are + (V3, /3, 3)", 
+(-1, 2,2)", +(5/V3, 1/3, 1//3)" and 8 more by cyclic permutation. 

E is compact and so f(x, y, z) = 2(x+y+z)—xyz assumes its bounds on E. 
If a bound occurs in interior, then point is stationary point without constraint; 
if in {(x, y, z)"|x*+y*+z* = 9}, then pointis critical point of funder x*+y?+z* = 
9. Hence bounds of fon E are taken at some of the 16 points of (i), (ii). Evalua- 
tion shows spuremum 10 (at (— 1, 2, 2)” etc.), infimum — 10 (at (1, — 2, —2)7 etc.). 
9. Theorem 7.71 applicable in (i) and (ii). In (i), critical point (4, 0, 4)", which 
satisfies 4x*+ y? < 16, In (ii), critical points (2,0, —1)",(—2,0,3)",(—4, +4/15,3)7. 

By argument of 8, bounds of x*+y*+ 2? on {(x, y, z)"|x+z = 1; 4x*+y? < 16} 
taken at some of the five critical points of (i), (ii). Supremum at (—4, + 15, 3)7; 
infimum at (4, 0, 3)”. 


iO) 
1. @) af(x) = Df (x(x) -5 x,D; f(x). Hence 


afc) = aS xiD.Sta) = 3 xi( $x, D.D,fla)+ D0). 


(ii) Take & = (4, ..., £m)” with & + 0. Multiply first row of H/(€) by & and 
add to it (2nd row)+...+£,(mth row). By exercise 7(b), 3, all elements of 
first row are now 0. Hence £,Hf(€) = 0, ie. Hf(E) = 0. Since Hf is continuous, 
Hf(é) = 0 also when £, = 0. 


2. When (x, y) + (0, 0), 


D, f(x, y) = paid ata] 


(t+ py)? yeas 
Since f(x, 0) = 0 for all x, D, f(0,0) = 0. D,/ is continuous at points (x, y)” 
+ (0, 0)". |D, f(x, »)| < 3|y| and so D, fis continuous at (0, 0)" also. Dz f(x, y) 
=—D, f(y, x) has same properties. Hence fis differentiable. 

All second order partial derivatives exist in R*—{0}. Also 


D:D; f(0, 0) = lim {D, £0, Y)— Di FO, jy ua (-Yiy = -1. 


Similarly D,D, f(0, 0) = 1, Dif, 0) = D3 f(, 0) = 0. 


3. Both sides equal A(h,k)/(hk); e.g. if g(t) = f(E a th, n+k)—f(E, n+), 
there exists in (0, 1) such that A(h, k) = g(1)—g(0) = g(a). Again, by mean 
value theorem, 


{Di fE+ah, 7+k)— Di fE+ah, n}/k = DoD, f(E+ah, 0+ ’k) 
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andr.h.s. + Dz D, f(E, 7) as (h, k)" + (0, 0)". Thus, given e, there exists 6 such that 
(Da fE+h, 9+ Pk)— Daf, 1+ BK}/A— Ds Di fE, 0)| < € 

if 0 < |Al, |k| < 5. Take 0 < |h| < 6 and let k +0. Then 


[{(DafE+h, )— Daf, Mi/h—- D2 Di FE, | < & 


4. Let g be a real function differentiable at 0 only (¢.g. g(x) = x* when x is 
rational, 0 when x is irrational). Define f by f(x, y) = g(x)+g(y). Then D, (0, y) 
=D, f(x, 0) = g'(0) for all x,y; and D, D, f(0, 0) = D:D,f(, 0) = 0. All three 
sets of conditions involve the existence of D, f, D, f in an open set containing 
(0, 0), but D, f(x, y) exists only when x = 0, D, f(x, y) only when y = 0. 


5. The continuity of the kth order partial derivatives implies the differentiability 
of the partial derivatives of order k—1,. Hence f and its partial derivatives up to 
order p—1 are differentiable. Then, by induction and the chain rule, for 
ke = 1, oes Ds @™(t) (|t| < r/||hll) exists and equals D” £(£)(A)*. By C1, 81, there 
exists « € (0, 1) such that 


g(1) = g(0) +e’) +... +8" %O)/(p—1)!+9°@)/p!. 


6. By 5, for |hl| < 4, say, f(E-+h)—fE) = sD*fE+ ahh’. 
@If Af@>0(k =1,....m), by continuity, A, f(E+h) > 0 when 
A] < 8 <0), Hence f(E+h)—f(E) > 0 for 0 < ||h| < &. 
(ii) Similar, 
(iii) Take any he R™. When 0 < t\|h|| < 4, 
A(t) = fE+th)—fG) = yD°*f(E+ athy(th)’. 


As t+ 0, A(t)/t® + 4D*f(E)(A)*. . 

If fhas a minimum at £, A(t) > 0 for all sufficiently small ¢ and so 4D2/(£)(h)* 
=lim A(t)/t? > 0. Since this holds for all h, D*f(E)(.)? is positive semi definite. 
If f has a maximum at &, then D*/()(.)* is negative semi-definite. But, if (iii) 
holds, D?/(£)(.)? is indefinite. 


7. f has stationary points (0, 0, 0)", (—1, —1, —1)7,(—1, 1, D7, (1, 1, 1)", 
(,1, —1)7. At (0, 0,0)", Hf = 2, H,f=4, Hsf = 8. Elsewhere Hf = 2, 
Hf = 0, Hsf = —24. Minimum at (0, 0, 0)"; no other maxima or minima. 

Infimum of fin x*+y*+z* < a? taken at (0,0, 0)? or on x*+y?+z" = a’, 
funder constraint x*+ y*+2z* = a* equivalent to a*+ 2xyz under same constraint. 
Critical points (+ a/V3, + ya/,/3, +.a//3)", (+a, 0, 0)", 0, +a, 0)", (0,0, +a)". 
f(a, 0, 0) = a®, f(+.a//3, +a]/3, + a/s/3) = a? + 2a%/3V3). When a® < 42, 
infimum 0; when a? > 27, infimum a*—2a*/(33). 


8. Stationary points (0, 0)7, (4, 4)”, (—4, 4)". Maximum at (0, 0)"; neither maxi- 
mum nor minimum at (4, 4)", (—4, 4)". If f attained its infimum on K at an 
interior point, this would have to be a minimum. 


8 (a) 
1.0) ¢~¢.Q¢~y~=¢= You, where a satisfies (i), (ii), (iii). Since « 
strictly increases, #~ exists, so that yy = doa, Clearly «~ satisfies (i), (ii), (iii). 
(3) d6~ wandy ~ x= ¢ = poaandy = yo = ¢ = xo(foa). If a, f satisfy 
(i), (ii), (iii), so does fox. 
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2. Define «: [0, 3] + [a, 5] by 

a+4(b—a)t @O<r<\J), 
ie 


“S bt treet (l<1<3) 


and put y = doa, Then y ~ 4, but y is not differentiable at 1. 


3. Let 4", ': [i—1, i] > R” be (equivalent) representations of y; (i = 1, ..., m) 
and define ¢, y : [0, m] > R" by 


a) = oO), Wt) = Wt) (i-1 <1 <i). 


There exist «:[/—1,i]+[i-1,i] such that ¢' = Yoa', a(i—1) = i-1, 
a‘(i) = ‘and (ii), (iii) are satisfied. Since «(i) = a'**(i), we can define  : [0, m] > 
[0, m] by a(t) = a(t) (i-1 < t <i), For i-1 < t <i, i-1 < a(t) = a(t) <i 
and so d(t) = di(t) = wi(a(t)) = y(a(t)) = (a(t). Since this holds for all i, 
¢ = wou, Also @ satisfies (ii), (iii). 


4. Let 1, ¢* be the restrictions of ¢ to [a, u], (u,b). Define «!: (0, 1] > [a, u], 
a: [1, 2] > [w, 5] by 


a(t)=at(u-a)t O<t<1), @(t)=ut+(b-ult-1) (<1 <2), 
Define ¥" on [0,1], ¥* on [1,2], % on [0,2] by y= doa (i = 1,2), 
Y(t) = w(t) for i-1 < ¢< ¢ (i = 1,2). Then y' ~ 4}, y* ~ ¢* and clearly 
y ~ ¢. Since y represents 7, +7, and ¢ represents y, 71+. = 7- 


5. If ¢ on [a, d] is any representation of y and @ is the dissection of (a, 6] with 
no intermediate points, ||q—pl| = A(D,¢) < AX). 


6. Trace {(x,0)|—1 <x < 1}. A(y,) = 2. A(y2) = 6. 3 not of bounded 


variation. 
qn ‘am |p 
P P P Pp 
7 A -{ 2(2+1) cos — t\dt = 4, ( +1)af cos tdt = 8(p+q)a. 
ne lo Mg) |S 2g | P\q 0 2q paa) 


8. A(y) = ik VQ+2)dt = /6+log(/2+/3). 


9. Let a<u<v<b, By theorem 8.12, s(v)—s(u) = At(d) and, by (8.11), 
0 < Ax(d) < Vid) +... + V2g,). R.h.s. > 0 as v—u > 0, by theorem 6.44. 


10. Adapt the proof of exercise 6(g), 3, using 9. 
11. Since |f| < 1, the series defining 4, y converge uniformly. 
If x, = 0,then0 < 7 < fand f(r) = 0; if, = 1, then} <7 < lL and/f(r) = 1. 
In either case, f(r) = . 
37 = even number + 0-(2«,)(2/,)...(in ternary scale), 


Hence f(3’7) = a. In general f(3°"-*7) = a, and so ¢(7) = &. Similarly (rt) = 7. 
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8 (4) 
1. Since ¢ ~ v7, ¢ = you, where « has usual properties. There is a dissection 
a=a <a <... <a,=b such that ¢, are continuously differentiable in 
each [a,_;, a;] and yf is so in each [c;_,, cj], where cj = a(a;). By theorem 6.92, 


[ viomn = [" eiewrtena 
‘aj ‘aj . 
= [" Wiothoaliioaa’ = [ cone 
aya aj. 


Second part similar, for (|y;|ox)a’ = |¢;| since |a’| = o’. 


2. In an interval [a,_,, a)] of continuous differentiability of ¢, 
|  G(—D)(—G(— dt = i AGO) GUA. 
-ay 7 


3. ¢ on [a, b] represents y, is a dissection of [a, b]. Then 


[EAOCr)} (0) - PD} < TIAGO |) - $s) 
< LPP) |{sg)— sy(ts-D} < MAC). 


As (2) > 0, first term > If np third term +f \F lds. 
+ y 
4%:x=ty=00<1t< 1); f =0. 
v1 
Yix=l1,y=tO<r< 1); i = (1/,/2)are tan(1/,/2). 
Ys 
Ysix=ty=tO<t< 1); i = 1-(1/,/2)are tan /2. 
ys 
if -{ = 7/(2V2)-1. 
¥ yitya- ys 
5. Trace = {(x, », z)|x2+y" = 2ax}n {(x, y, z)|x*+2 +2 = 4ax}. f = 8a", 
7. 
6. it = ysmabe, i; = —yy7abe. 
Y o 


7. ¢ on [a, 6] represents y; @ = ay < a, < ... < a, = 6 are such that ¢ is 
continuously differentiable in each [a;_,, a]. Then 


[r= fvem.9 = 3 [ (Enecnseo) a 


=> iP 4 to@idt = ¥ Lel6))- e160 
g=1 Jaya favs 


= g(v)—gtu). 
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8. By hypothesis, g is uniquely defined. If xe D, B(x;6) < D for some 6. 
For |t| < 6, x+te'e D, where e has ith component 1, others 0. If |h| < 6, 
let y,(4) be the segment from x to x+he‘. Then 


a(x+he') = f= g(x)+ [iterterds, 
yet yi(h) 0 


eethe')—a(x) _ 


‘4 1 f* di 
Le. h if Sixt te')dt, 


Since fis continuous, r.h.s. > f(x) as h > 0. 


9. 1 = csinh (a/c). sech*x < 1 (x > 0) = tanh (a/c) < (a/c) + (d/de)c sinh (a/c) 
< 0 for c > 0. Hence c sinh (a/c) decreases as c increases. Since c sinh (a/c) > 
«© as c+0+ and +a as coo, the equation in c, c sinh (a/c) = / (> a) has 
a unique solution. 


10. 3514/25. 


8(c) 
1. To simplify notation, take a; = 0, b; = 1 (i = 1,..., ). Let D, be the dis- 
section of [0,1]... x[0, 1] into r" congruent subintervals. If M = sup |/|, 


A a eae ee 
Ls (ondh-o/(i wee 7 satel sr aera 


2nM 
larg aa) as r>o. 


2. There is a dissection Y’ of J into subintervals J, ..., J, such that 
r 
SD, f)-(B,f) = XY (Mi-m) VU) < €. 


l=1 


Let D be the dissection of K into the subintervals K; = 1;xJ. Since V(K,) 
= VI)V), SQ, ¢)-(, ) < eV). 
Similarly y: R"™xJ-— R', defined by W(x, y) = g(y), is integrable over K. 


Hence A = $y is integrable over K. Also fix, y)dx = 20) | S(x)dx. Use 
ve 
theorem 8.31. 


5. Inner integral is elliptic, not expressible by elementary functions. But integrand 
continuous, so interchange of order of integration legitimate. Integral 
= #(tan a—sec a—cos «+2), 


6. Define ¢ : [0, 1]> R by $(x) = 0 (x irrational), 4(x) = 1/q (x = p/q,p,9 
‘1 
coprime). By exercise 6(A), 9, / ¢ exists and is 0. Let 2’ be a dissection of [0, 1] 


into subintervals [a;-,,a@,] such that S(Q’, 4) < e. Let f*:[0, 1]x[0, 1] > R# 
be given by f*(x, y) = 4(x); let D be the dissection of J into subintervals 
(aca, 4] x [0, 1]. Then s(M,f) = 0 and S(,f) < SD, f*) = S(D’, ¢) < 6. 
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1 
By exercise 6(h), 9, it f(x, y)dx = 0 for every y. 
0 


1 

By illustration (ii), p. 141, f f(x, y)dy does not exist for any x. 
0 

h = f+g, where g is defined like f, but with x, y interchanged. 


7 a 
ae i f(x, y)dx = 0 for every »; j, S (x, y)dy exists for x = 47 only. 
0 0 
Let 2 be a dissection of J = [0, 47] x [0, 1] into subintervals Jj, ..., J-. Then 


s 1 7 
S8,N)-19,f) > 3 (4-9) Vd = 75 


Hence fis not integrable over J, and so not over J. 


8. Any [x,x+8]x[y, +4] © J contains a point of P,, where p, > 1 /6. If 
a= mip (p prime), then the lines x = a, y = a each contain p—1 points of P; 
if a not of this form, the lines contain no points of P. 


1 
For every x, f(x, ) = 0 for all excepta finite number of y. Thus [ S(x,y) dy = 0, 
i o 
fel f(x, y)dy = 0. Since P is dense in J, [f- 1, [f- 0. 
0 = 
a 1 1 
9. 1f0<y< iH S(x, y)dx = 1. Hence [ | S(x, yydx = 1(y = 0, 1 need 


1 1 
not be considered). f dx | Six, ydy = -1. 


8(d) 
1. Let J, > E; let 4, J, be non-overlapping with common face. Then fg = 0 
in ,—(h, 0 Jy), so integral of fg over J, is 0. Use (8.33). 


2. Call interval J; 1, = [a, +6, b:—€] x «.. x [@n+€, bn —€], (€ > 0, small). Then 
I, © 1¢ Tc) < CD) < eZ) < eZ). 


3. Let m = inf f, M = sup/, / any closed interval containing E. Then 
0= me(E) = f me <| fe < J te < [ Mee = Mc(E) = 0. 
I PR I 


4. (i) f = 1 is not integrable over a set without content. 
Let A < E < I, where A has content, /is a closed interval. If 2 is a dissection 
of J into subintervals J,, 


SQ, fa)—(D, fa) = (B+ L_t+ Zs) (My —m,) c(h), 
where =, ranges over the J, ¢ A°, E, over the J; ¢ I-A, s over the J; with 
points of frd. Then 2, < S(D,fz)—-(D,fz), X2=0, Us < {SQ Xa) —- 
(D, Xa) (sup fz —inf fz). 2s, Zs > 0 as MZ) > 0. 
(ii) fe-x = fa—Sx- 


5. (i) Replace function yz of exercise 6(h), 5 by fz. 

(ii) fintegrable over E, N E,, by first part, and so over E,— E, = E,—(E,N E), 
by 4 (ii). 

(ii) Put f = f*+—f-, where f* = Hf| +f) = 0,f- = HIFI-/) 2 0. 
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6. Let m = inf f, M = sup/ in E, J a closed interval containing E. As in 3, 


mes) < | fe < J fee < Mey 


and so integrals + 0. Also, since fz = fz_x,+fx;, 


[a < [ fent ftw [ 2 [fet | fe 


and so i Se < lim int [ Sr-x, < lim sup if Spx, <f Sr 
I ir T JT 


7. (i) If m = inf f, M = sup f, / a closed interval containing E, 


J mXp < [fe < Mxz- 
I Ki I 


(ii) Since E is compact and connected, so is {(E) < R'. Hence f(E) is the 
finite closed interval [m, M]. 


8. For x,y € J, put ||x—y|| = 4, min(x, y,) = u;,max(x;, »)) = 4; (i = 1, ..., 1). 
Then 0 < v,—u, < 6. If M = sup |f| in J, by 5, 


Lf ‘ ne i) i eyuaeds’ | 


ae 


< Me(J,—J,) 
=0(6) as 6>0. 


9. Let D be closed disc with centre (a, 6), radius r. Then yp is continuous except 
on path given by x = a+rcost, y= b+rsin¢ (0 < 4 < 2m). Hence c(D) 
exists and, if J = [a—r, at+r]x[b—r, b+r], 


a+r ber ‘a+r 
e(D) = f Xp -[ dx Xv(x, ¥) dy -f 2V(r?—(x—a)*)dx = mr’. 
I a-r b-r a-r 


Since c(fr D) = 0, c(D°) = c(D). 


10. (i) There is a dissection of J into subintervals /, such that 2(M,—m,)c(I,) < €. 
If J; = 1.x [m, M, +6] (note m, may equal M,), E < UJ; and 
Le(Ji) = U(M,—m,+€)e(h) < e+ec(d). 
(ii) Let 
Do = {15 «+s Xnsr)| Cs +s Xn) € B°, 0 < Xngr < f(Xy, «5 XW 
Dy = {4 0-5 Xnta)| ay «5 Xn) © E, 0 < Xp < SOs «+s Xn) 


D, is open, D, is closed. Since xp is constant in Dy and in D‘, yp is continuous 
on DU Dj. 
Let J be a closed intetval containing E, S the set in (i) corresponding to 


felfg> Pf (pn p,) & (Ix {0} U SU CrEXI0, q) 
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and sets on right have zero content. (fr£ has content 0 in R”.) Hence yp is in- 
tegrable over J = 1 [0,q] and 


a 
c(D) = fx = [drei f XD(X1y «++» Xng1) ng 


"PE\ Drs +004 En) 
= [ars f Idea = ffi ={ if 
I 0 ; I E 


3 3 
11. In both parts the subsets of R* have content. (i) * » di) 7 (5-3) ty 


13. Let Ebe triangle with vertices (0, 0), (1, 0), (1, 1). Since integrand is bounded 
on E and continuous except when x = 0, 


‘© 1 1 ca e=1 
av{ ered -{ evedxdy -[ ax [ evdy = ——. 
0 y Ez 0 0 2e 


14. E has content and integrand f continuous on E. If 
A, = (y, z)|y > 0, z > 0, y+z < 1-3}, 


1 1 1-2 pl-2-y 47 
{ real ax Sdydz =f ax av{ fdz =<--. 
E 0 As 0 Jo 0 574 


15. ¢ on J = [a, 6) x [a, b] given by A(t, u) = f(t) is integrable over I (exercise 
8(c), 2). Hence (x—1)"-1f(¢) is integrable over J and so over triangle with vertices 
(a, a), (b, a), (b, b). Then 


e a) me 
w-pf Alu) du -{ du | (u—t)"-f(dt -[ arf (u—t)f(t)du. 


8 
1. o differentiable at x: as h>0+, 
foct hf) _ olx, xh) fO)-fO—M) _ olx—h, xD) 
h ~ e(fx, x +A)” h c((x—A, x]) 


fe differentiable at x: |f(x+0)—f(x)—1f'@)| < et if \t| < 6. Hence, when 
< hk < 6,h+k > 0, 


a([x—h, x+k))_ p, 
Gira 


= Wet) SO) = KF +|FC)~FE-W=MFOD! e 
a h+k e 


2. (XX) = c(X) = 0, 80 o(X) = o(XU X) = o(X)+0(X). 


> Do(x). 


i) 


8(f) 
1. (i) If there exists x € J(u; a) such that x ¢ E, then the segment from u to x 
(which lies in J(u; a)) contains a frontier point of E. Impossible. 
(ii) If there exists x € (R"— I(u; b)) 0 E, consider the half line A from uw through 
x. Since E is bounded, there exists y¢A—J(u; b) such that y ¢ E. Hence the 
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segment from x to y (which lies outside J(u; b)) contains a frontier point of E. 
Impossible. 

(Clearly the cubes could be replaced by convex sets S,, 5 with S, © S, and 
EnS, + 2.) 


2. If X is the set of points of discontinuity, proceed as in (ii) of proof of theorem 
8.61 (8.62), but let S, cover QU X (QU XUfrG). 


3. Let AB be side in question, C opposite vertex. A rigid body motion takes 
A, B,C to (a, 0), (6, 0),(p,q), where q > 0. Let a<p <b. Since segment 
from (p, 0) to (p, g) has content 0, 


? g(x — ® a(x — 
content - { ac f bel, 
a p-a ip p-b 


dx = 4q(b-a). 


Cases p < a, p > b similar. 
5. 4ab(a*/p* + b*/q*). 


6. Clearly ¢ is continuously differentiable and injective in R®. E = oD) 
= {(u, »)|0 < u < v < 1}, J¢ = 1. Integral = 47-4. 


7. IJd(x, y) = 8xy, so JG(u, v) = (uv)-+. Content 4(6—a)(q—p). 
‘20 '2a(1+cos 0) 
9. c(S) -[ do if rdr = 6na®*; centroid (a, 0). 


10. If Dis the disc with centre (—2a, — 2a) and radius /40a, then 


o(Q) = ik (PF) dxdy = 1007a’, 


2 8a 
11. (i If, in R’, D = {(x, »)|x*+y* < 4a}, 


content = 2 fi Vat—x8—y9) dedy = (8—3y/3)na°. 
Gi) If, in R, E = (7,00 <r <asind,0 <0 <7, 
content = 2f Mat—rrdrdo - 4a ["c—loostapaa 
= $a i "(1 —cos*@)d = 3(37—4)a’, 


12. (i) Given x,,...,%n, xi+...+22 =r? determines r; then x, determines 
On—15 +++) Xs determines 2, x, and x, determine 0,. 

Let J, be determinant with r = 1, so that J = r"-,. Multiply first row of 
J, by cos O,_;/sin 0,-, and subtract from last row. This becomes 27.5.0; 


—I/sin 0,,, and sin 0,_, factor of all elements in first m—1 columns. 
J, = —sin"~*O,_,Jn_1. Since J, = 1, result follows. 


7 
ii) Use theorem 8.62 and note that, if J, = i! sin’0d0, 


Taxalox = 71k, Taelany = 2m/(2k +1). 
13, (19-24 log 2)/36. 
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an Pl 
14. J, Dify = { arf D, flr cos t, r sin t)rdr 
B 0 0 
7 1(a a 
= arf (Fue cos t, r sin t)r cos t]—— [f(r cos ¢, r sin ¢)sin a} dr 
0 0 ler ot 
on 1 fan 9 
= i) Alco t, sin t)cos tdt— f af wl cos ¢, r sin t)sin t]dt 
0 


a 
= f Aflcos t, sin t)cos tdt, 
0 
by theorem 6.84. Similarly 


f ri Dene 16 fAcos t, sin #)sin tdt, 


8(g) 
xX 
1. For every X > a, Ox = f f(x, .)dx is continuous on the compact set Je 
a 
Adapt the proof of theorem 5.35. 


2. Since = [im .)du, wy = f(., y) are continuous, 
a 
a fu c xc 
DFO =F ik ( f flu, «du do - i Flu, y)du, 


D.DAF Ux, 9) = = [Sle y)d = S09). 


3. Let (7) exist, where 7 = (71, «+» Mn). Take any y = (J, «+5 Yn) in J. Then 
L(x, )-F(% 1) 


Va Is 
= [Dan S66 Ie yd PP De Pls tab es dae 
nm Ne 


‘Un 
tot f Dyn % My Nay v+y tat 


and rhs. is continuous on J (theorem 8.71). Hence f(., y) is integrable over J. 
Formula for and continuity of D,¢ follow from theorems 8.71, 8.72. 


4. Define f on [a, b]x[c, d] by f(x, ») = 1 & rational), 0 (x irrational), Then 
D,f (=0) is continuous, but f(., ¥) is not integrable for any y. 


6. When showing ¢’(a) = 0 distinguish between a = 0, a + 0. Since ¢(0) = 0, 
(a) = 0 for |a| < 1. For |a| > 1, 


9(@) = d(l/a)+ i log atdx = 27 log |a|. 
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7. If % on [e, d] x [e, dis given by W(y, z) = [ir y)dx, then 
Dilton 2)= [Dif de, Duf,2) = S91 


and $') = Cdidyybhty, e0)} 
= Diy, g0)}+8'O) Dally, 20)}. 


8. Since B is a region, independence of path of f J is equivalent to existence of 
Y 


g such that f = grad g (8(4), 7, 8). 

(N) If f= grad g, then Dif; = D,D,g, Df, = D, Dig; D; D;g = D; Dig, 
since both are continuous. 

(S) Let c = (¢,..., ¢n) be centre of B. For any x = (m4, «6, Xn) € B, let Ye 
be the path from c to x consisting of the segments determined by the points 


(Cay ese Cndy (Cay vey Cnmty Xp 02s (Cty Xap e+e Xndy (Kay vvey Xue 
Define g: B > R! by 


7 Sn 
a(x) = f f= [ Silt, Xas wo edt f SulCrs +045 Cus» tat. 
Ye 1 Cn 
Then Dyg(x) = fi(%1, ..-, Xn) and, by theorem 8.72, for i > 2, 


Ty ‘Lit 
Dig(x) = i Dy fltizw sha tater (os (DL a(R Poa eee 
Cy 


an 
FIC oy Cnty Xty v009 Xa) = SlXry ory Xap 
since Dif, = Dyfi, ..., Difir = Diafe 


9. log(b/a). 


ae 
ll. (i) For y>0, 6) = f mY a = 4n, since integral converges uni- 


formly for y > 6 > 0 (see example of §6.9). Hence O(y) = 4ny+A (y > 0). 
But ¢ is continuous on R' and so 0 = (0) = lim (Gmy+ A) = A. Since ¢ is 


even, $(») = 4/9 (ally). ae 
(ii) Call integral Y(y). Then ’(y) = 47 (y > 0) and ¥(y) = iny* (y > 0), 
—iny' (y < 0). 


12. |sinh xy| < cosh xy < ell < et” for x > 2|y|. This gives existence of 
co 

#(y) and uniform convergence of | xe-**sinhxy dx (integral for ¢’(y)) on every 
0 


finite interval. 
Differential equation implies e~!“4(y) = A. Since (0) = 4y7, 6(y) = 4y7et”. 


13. Integrals for 4(»), $y) converge uniformly for all y, integral for ¢’(y) 
for y2>6>0. Differential equation shows $y) = Aev+ Be+47, 
$y) = Aev—Be~” for y>0. These also hold for y=0, since ¢, ¢’ 
continuous on RY. ¢(0)=4(0)=0 give A=0, B= —in. Thus 
$y) = 47(1—e~) for y > 0, dy) = —4n(1-e") for y < 0. 
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ere tan La dx. since integral converges 
(1+ b'xt) i. ° 
dx 


0 
uniformly for b> f> 0. Similarly D, D.¢(a, b) =( tain) (1+ 5x3) if 


14. For any a, if b > 0, D,(a, b) = je 


6 > 0; integral = 47/(a+5) if also a > 0, 

For a > 0, b > 0, D.d(a, b) = 47 log(a+b)+ A, where A independent of a. 
But D,d(a,b) +0 as a+0 and so D, (a, b) = 47{log(at+b)—log 5}. Hence 
(a, b) = 4n{(a+b) log (a+b)—a—b log b+B}, where B independent of b. 
As b +0, d(a, b) > 0 (and b log b > 0). Hence B = a—a loga. 


15. Use theorem 4.73 as in proof of theorem 6.33. Integral = (7/2)!. 


9 (a) 
nm 4 cos 3x, cos 5x ) 
1. 3-3 ( +r +g t+): 
2 8 14+(- acer 
5. Os) ame R nsin nx, 
® 
a4 De oth ;Sin(2n+1)x_ if b is even, 


7 ym (2n+1)?— 


10. In example 4, 4, is a lower approximative sum to the integral 


m sin tx 
—- dt, 
[ t 
in uw 


For the last part, the analogous integral is sme du, The integrals over 


(0, 7], [7, 27], (27, 37], ... have alternate sign and decreasing magnitude. 


9 (6) 
2. x% sin(1/x) (0 < « < 1). 


9(c) 


2. By theorem 9.54, given ¢, there is (— 4, 6) in which osc, Fourier series of /, 
is <e, Osc. Fourier series of f, in (—6, 6) is 2kA, where A is the Gibbs ratio 


2 2 ta sin ty 
9d) 


1. No. |z| > R and lim sup|a,|”" = 1/R contradict a,z” = o(n). Theorem 9.62. 
=z" summable (C,1) for |z| < 1, z + 1. 
Uniformly summable in {z| |z| < 1, |z—1| > 4}. 


506 SOLUTIONS OF EXERCISES 


n 
2. (i) s,(x) = Dia,x" increases both with n and with x. 
1 


From theorem 4.73, since lim lim exists, so does lim lim. 
r>1- no no 21 — 


(ii) Write n|a,| = cp. Givene, take m to make c, <¢ for n> m. Use 
1-x* < k(1—x). 


Ea. Zaar 


c 


<(1- =o et See 


m+lnot 


Take x = 1—(1/m) and let m> a, 
3. We can take c, real and k = 1. Given ¢, choose N such that 


d,1i—€) < ¢, <d,it+e) for n>N. 
CJ N o N cI 

Then C(x) = Dene” = D+ VD < Dlenle"+ +e) Didar" 
0 0 N+1 0 (i) 


@ 
Divide by D(x) = Sid,x" and let x >1-. 
0 
lim sup{C(x)/D(x)} < 1+6. 
Similarly, lim inf > 1—¢. 
4. Integrate 1s (1 -s 4) x* sin xdx by parts. 


Sum (A) = lim i e-2 f(x) dx. 
60+ J0 


9 
1. (f+g)? and (f-g)*. 


2. Use Parseval on §9.2, example 1, and exercise 9(a), 7. 


3. Use 1 and exercise 9(a), 2. 


9/) 
1. m\a(u,)—a(u,)| < ([r+ fe) it| fr, f(t) (Cos uyt—cos ust)dt} . 


Given ¢, there is N making first two f 's on right side less thane. 
Last term < N|u,— ul {, If| < ¢ if |u;—4,| small enough. 


0 
3. The transformed integral j, e-™ cos xu du is elementary, with value b/(x*+ 5”). 
0 
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10 (@) 
1. (i) Collinear z, <> J real A,, 42, A; with 2A, = A,z, = 0. 
From the last, 2A,z, = 0. Hence condition 


tate 


Gi) 1 ae! 
2% Z, 2Z3| = 0. 
2, 25 26] 
2. See Note (2), Constant term in f(z) is n! ay. 
3. If |z| < 1,2 +1, 
|(@—z)Za,2"| = |ao—(ao—ay)z—... — an2z"4| 
> Ay—|(Ag—ay)Z+...+y2"41| > ag— {(ag— ay) +... +an} = 0, 
since the z’ (r = 1, ..., m) have not all the same phase. 
4. Ifx > 0, phz = arc tan(y/x). 
If x < 0, phz = arctan(y/x)+m7 for y>0O or <0, 
Ifx = 0, phz = +47 for y>0O or <0. 
5. None; all except +7; only 0; real z. 


6. +09 = k > uuz,t+vv, = uuy+v, =O>u=v=0 or u4,v,—u,v, = 0. 
C-R equations, 


7. These rules give a ‘dictionary-order’, but do not satisfy the axioms of an 
ordered field (see an Algebra text, e.g. Birkhoff & Maclane, Survey). 
If for example, a = —1—i, b = 1—i, c = 2i; then a < b but a+c > bt+e. 


8. Solve with the conjugate a7+bz+@ = 0. 
If |a| + |b], one z. If |a| = |b], none or infinitely many according as ac + 
or = cb. 


9. Use |A|* = AA. Equality in Cauchy-Schwarz if a,/b, same for all r. 


10. Assume >. Repeated bisection (C1, 59) of [z,, z)] gives contradiction. 


10(6) 
1. If ima > 0, then |z—a| < |z—a| <> imz > 0. 
2. (i) Circles on diameters (—3, —4) and (0, 4). 


z-a 
1 


4. By continuity at frontier, w is real if z is real, Use §10.5 (2) with 0, 1, 00. 
For last part, put z = i. 


3. From §10.5 (8), w-1 =k 


Values for z = 0,1 givek = —1,a= —}. 


3° 
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5. If two fixed points «, 8, then py ot 


ZB nah 
If |k| < 1, z, >; if |k| > 1, z, >. If |k| = 1, no limit. 
Ifa = f, zn >a, 


w-1 z—1\3 ai m 31 
6 Ha = (i). |w| <1 gives Ph ~ a [5 a 


z- locus is three lunes, vertices at + 1 and angles in ranges ap é 3 |: [%. # |: 


3m An 
ae ae i 
wat = (5S 4 
wtl \z-2 


8. Fixed points are e”'", e~”". Mapping is 


ae . See 6. 


w—etin 
w—e-min 


Regions rez, > 4. and |z,—1| > 1 


1+2z, 23-1 
2 3 
=o ns See 
oT 


9z,= 2, 2 


10. Given R, there exists m) such that |z,| > R for all n > no. 


10(c) 


1. (i) and (ii). Every value of either side is a value of the other. Principal values 
are equal in (i), not always in (ii). 


2. exp(—2m+4)z. 


3. (i) |z] = & go into confocal ellipses; phz = a into confocal hyperbolas. 
For (ii), combine (i) with z = exp ¢. 
4. iz exp(—iz). 
5. Strip 4(2m—1)m < x < 42m+1)7. 
6. fO<r<1, 
= awa _rsin @— } 
log (1+z) = 4 log(1+2r cos 0+r?)+/are tan (2 
Equate real parts in £(—1)"“1z"/n = log(1+z). 


Let r>1-—. First series = 4 log(4 cos*40) for —7 < 6 < 7. Second series: 
sum = re log(1+e!cos 0) = 4 log(1+3 cos*#). 


yi pz) _ ms} 
7. Let z, = x,+iy, (r = 1, ..., 7") be zeros of p. x, > 0. => : 
PZ) Tz2-z, 
Suppose p’(z) = 0 for z = x+iy, where x < 0. 
Then 0.= B——— 
ras 
Real part of right side <0, Contradiction. 
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8. Absolute convergence if x > 1. Uniform convergence for x > 1+9. 


9. (i) If z = Zo, |zo| < 1, take 6 with |zo| < 1-8 < 1. wc. in |z| < 1—é by 
M-test. 

(ii) if re wy) < —é < 0, then |z"7"-!| < n--?, 

(iii) Dirichlet’s test. 


© oo 
10. Let ©) A,(@) = ¥\(a,cos n9+b,sin n9) be the Fourier series of f(@). Then the 
0 0 


Poisson integral (theorem 9.73) is 
Ey 
DAO)" = re L(an—ib,)2" = re $(z), say, 
0) 


where ¢ is regular for |z| < 1. 


11 (a) 
1. 7iR*, —7R®, 0, 0. 


2. 3(1+i). From primitives sin z, e*. 
3. 2mi, —8i/3, 0, —4. 

4. Al, 9 (1—z)7. 

5. Yes, yes. 


6. Z. Z with segment [—2i, 2/] deleted. A region containing no circuit which 
encircles a point (+n+4)z, e.g. the strip —47 < rez < 47. 


7.R= ref (u—iv) (u,+ iv,) (dx+ idy) = feau+003 dx+ f (—uv,+ viz) dy. 
Y 
By C-R equations, latter i = feeis ees So R= }u'+v")}, = 0. 


8. Theorem 11.11, Since |e"*| = e~” < 1 ony, f is O(1/R). 
Integration by parts into 
2e" 
[e}- y int 


gives each term O(1/R®), a smaller bound. 


9. f(z) = {k+e(z)}/(z—a), where |e(z)| < € if 6 < 6) and « < ph(z—a) < f. 


[r= [i ereeniae nea) as 5+0, 
Y a 


o  idy pent 
a. a dy = Ti. 
a le (5 aE 
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12. Call the integrals I,J and the inequality to be proved |S| < 77. Use 


[fe |? = fe FE; 


7 ~1) 
J Oe'?9 dO = 20" Gnteger p +10), = O0(p = 0); 
-n 
n 
i 9d) = 0(p + 0), 27(p = 0). 
- 
N n 
Then T= & (-1)""andn f dem-0'9 G9 = —2niS, 
mn=1 -" 
J = 2nT, 
[Z| < mJ. 


Hence |S| < 77. 
13. Let z = 2(t) for a < t < b bea representation of y, 


b 
Phe i gfe} Ff {el0)}2'(at 


% dw 
= [ BW) dt = lh, 


11 (6) 


1. Quadrisect a triangle by joining mid-points of sides. Simple polygon can be 
split into triangles by diagonals inside it—proof by induction on the number of 
sides, 


2. Given ¢, take R, a square, centre ¢, side 26 so small that |f(z)| < ¢/é6 for z on 
Ro, 


By theorem ua, f fl < 8e, 
OR, 


we 


. Continuity of f’ is assumed. 
4. Along one side a(1—i), a(1+/) of the square 


‘dz a idy ti ytia 3 
—= —= dy = 4ni. 
z leaee -aaty i 


11 (c) 
. 2mia‘ (theorem 11.81), 27ie%/3! (theorem 11.91). 


. arc tan z (+77). 
. 2mi{n(y, 0)—4n(y, —1)—4n(y, 1)}. Possible values are +27, +7, 0. 


|. Theorem 11.91. 
aie) co x" \ exp zx 
x (5) ~ ni Jy (= a) Zz ee 


a 


since, for any given x, the & is u.c. on y. Let y be z = et” (0 <8 < 2z). 


CHAPTER 11 511 
5. Theorem 11.81. The < from §10.5 (8). 


6. Integrand is (te +> R- = f(z). R?/Z is outside C. 

7. Ify is £ = re, (0) = = om d= ai (u+ ivje-? dd. 
Qn 

Also ik (u—iv)e- dO = conjugate of |i (u+iv)e! dd = 0. 
0 0 


8 ws = 1 i (4-3) at, 


TE |z[°<1, cae =0. If|z| > 1, f(z) = —2z7i/z. 


(i f@ = 3 [eae and, ony, € = 1/6. 


9, Integrate along semicircle £ = Yet’ (0 < 0 < 7) and its diameter. By theorem 
11.81 and continuity of integrand for im¢ > 0. 


1 as 1 
fo-0= * [(4,--4,) 10. 
10. If a rectangle R in D,U Dy is divided by / into two rectangles R,, Rz, then, 


by theorem 11.42, 
He A i. a [ 3 
1 Ry 


f es W-fG) = conjugate of 


11. f, =f, onl. ft h@), 


Since f{(Z) exists, f,(z) exists. 


12(@ 


1. Branch point is z = —1 (if & is not an integer). 
Principal branch f, defined to be 1 for z = 0, is regular and has Taylor's 
series in |z| < 1. From p. 354 and theorem 12.11, 


Sz) = k(k-1)...(k—n+ 1) +2) 


and ESI repens SELL tk ely 
2. 422—ghoz4+qsz°...; R = 47. 


3. Method of (say) C1, ex. 6(d), 6, namely: 
If w = (arc sin z)*, then (1—z*)w" —zw’ = 2. 
From Leibniz’s theorem, 


(1—z2)w+) — (2n+ Lzwt? — nw = 0. 
Putting z = 0, we have coefficients. R= 1. 
4. z+429+y4254+...; R = 40. 
5. 1—4z*@—skz4...; R= 47, 
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6. 4-4z+d525...; R = 27. 


7 X- 1)"z*"**1/n! (2n+1)!(2n+ 1), all z. 


8. Xd,z", where d, = number of divisors of n, including 1 andm. R= 1. 
9. cot z = —tan(z—47) say. 
10, 27,2951; 1. 
11. f, regular at 0 and =O at 4, },4,..., =0. (i), (ii), (v) No. 
12. |a,| < Mir” gives 
[/(e)—a4| < Zlayl. lal" < ME /r)* = Mla|r— |). 
No zero if this <|ao|. 


13. If f = 0, 3¢ in D with f(£) + 0. This + holds in a disc B(¢; r). fg = 0 = 
g = Oin BCE; r) and, by theorem 12.12, in D, 


14, Use |A|* = AA. By uniform convergence of the series, 
Det 19) |209 sa fa +n eitm—n)O gp an 
ae =— a,rmtn eilm— = ai, 
zi |f(re!)|2al a Bandar e Lanaar 

all terms with m + n vanishing. 

15. By 14,a,=0 if n+k. 


k 
16. If p.(z) = > b,2”, the given fis 
0 


k ES 
Dilan bnl?-+  lan|®. 
0 k+l 


17. Let y be the circle z = Re’ (0 < @ < 2m). By theorem 11.81, 


1 (f)_fO) 4, 2a 
al(2-S) @ - 20-0. 


a-—b\z-a z-b 


J 


18. (i) In theorem 12.12, |a,| = o(r?-). True. 
(ii) fis a polynomial of degree at most k. 


MrR 


< ja-bR—|a(R—l5) 


If |f(z)| < M, theorem 11.11> 


19. (ii) If g(z) = f(z)—8i, then 1/g is regular and |1/g| < 1. 
Tf, a, b, c being suitable constants, au+bv—c > 0 [or < 0], then fis constant. 


20. Take f?. 
21. 1/|f(@)—wol < 1/8. 


22. fig is constant. 
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12 (6) 
Z ; Deez ial 
1. For 1 < |z| < 2, binomial expansions give 5 (3) -z (:) é 
0 T 
2. For |z| < 1, 1-z+z8§—zt+z°—-.... 
ee | 1 
For |z| > 1, Aras +aT 


4. For |z| > 0, taking f round z = e®, 
os Mee ences tae: 
J,(u) = Oni fi exp,(iu sin 4) nid 
To obtain the series for J, multiply the series for exp 4uz and exp (—u/2z). 


5, Either branch is one-valued in |z| < 1 (or in |z| > 2), hence expansible in 
Taylor (or Laurent) series. Cannot expand in 1 <|z| < 2. 


7. From §10.1, the Jacobian u,vy— uy v2 = |f’|*. 
ts a 
None J ae i) If(re!®)|2d8. See 12(a), 14. 
ir, 0 


12 (c) 
0. f(z) = z4—3z9+7z*—9z+6 = 0. We first look for real roots. f(x) = 0 if 
and only if x = 1. f(1) = 2, minimum, No real roots. 

To find the number of zeros of fin the first quadrant, let z describe the simple 
circuit (positively oriented) composed of (1) real axis 0 to R (R large), (2) 
quadrant z = Re (0 < 9 < 4n), (3) imaginary axis from /R to 0. Call the corres- 
ponding paths of w(=/f(z)), Us, 1's, I's. We need to find the index of w= 0 
for ',+I',+I. T, is part of the real axis and at f(R) we can take Phw = 0. 
On Ty, w = R'e{1+O(1/R)}. At f(UR), Phw is 27{1+ O(1/R)}. To trace the 
change in Phw on I's, we have w = u+iv = y’—7y®+6+i(3y*—9y). 

Mark the crossings with the imaginary axis u = 0. First is at y = 6, second 
when y = 1. At former v > 0, at latter v < 0; u changes sign from + to — at 
former, from — to + at latter. When w returns to /(0), the value of Phw is 47. 
The index of 0 for I; +I',+T; is 2. Two roots in first quadrant. By conjugates, 
two in fourth. 


1. By theorem 12.5 integrals are —47i, (—1)"27i/(n—1)!, 77. 


2. Take a + b.c = a—b. Residue at a is coefficient of 1/¢ in Laurent expansion 
about ¢ = 0 of "(¢+c)-. This is k,/c?*-, k, being the relevant binomial 
coefficient. Residue at b is k,/(—¢)*"-. 


3. Follow method detailed in 0. Rouché (theorem 12.62) with f = 5 shows no 
zeros in |z| < 4. 


4. 5. 8. As 3. 


6. On |z| = 1+0, |e*| < |z"| if 6 small. Rouché shows 7 roots in |z| < 1+6, 
There is one root z = e! with 0 = 0 on |z| = 1. 
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7. w = sinh 7z gives 
u = sinh 7x cos7y, v = cosh 7x sin 7y. 


The four lines y = +4, x = 0, x = ¥ bound a rectangle. 
As z describes its positively oriented boundary, w describes I composed of 
right half of the ellipse e ” 


sinh®X* coshtx ~ | 
from —icosh7X to +icosh7X and the line segment iv from v = cosh aX 


to —cosh 7X. If re wo > 0 and X large, index of w, for I’ is 1. Hence w = wo 
exactly once in the strip. 


9. f@ = =(=2) 


1-4z, 


has m zeros at 0 and » at a. |f| = 1 on |z| = 1 from $10.5 (8). Take in Rouché 
=-a. 


10. Method of 7. 
n 

11. Put £ for 1/z and p,() = YE" /r! 
0 


Given R, ¢, there is N with |p,({)—exp ¢| < on |¢| = Rforn>N. 
Take € < inflexp (Re®)| for 0 < @ < 27. By Rouché, exp¢ and p,() have 
same number of zeros in |¢| < R. exp ¢ has no zeros. All zeros of p, have |¢| > R. 


2@) 
1, None (removable at 1, —1). 


2. 3. Simple poles at (—1)+. At oo, 2 has pole, 3 essential singularity. 
4. Simple poles at 4(2n+1)7, Limit point is 00, singularity. 

7. Essential singularity at 1. 

8. Simple poles at 2n7i (n + 0). Remember ©, 


9. cos z = a+ib gives cos x cosh y = a, sinx sinhy = —b. 
Continue either (i) as in 12(c), 7 or (ii) directly (long) cosh y = A, + Ap, 


where A, ='4y{(a+1)?+6%}, Ay = 4y{(a—1)?+ b*}. 
Then cos x = A,— A, and cosh y = A,+ A,. Solve these. 


13 (a) 
1. @-Gii) |z| < 1 and |z| > 1. 
(iv) (vii) None. 
(viii) Strip |y| < log 2. 
2. (i) |z| <1. (ii) Z. (iii) x > 0. 
(iv) x < 2. (v) x > 0. (vi) Z, punctured at 0. 


(vii), (viii) None. 
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3. $n = (gt f)+(8—-A) Xn» 
where 2xa(z) = (2"?—1)/(2" +1). 
4. M-test and theorem 13.11. Simple poles at +i and +i/n (n + 1), double 


poles at +i. 
Singularities at 0 and ©, being limit points of poles. 


5. Analogue of corollary 1 of theorem 13.11. 


6. By theorem 13.11, any function continuous, but not regular, in D is an ex- 
ample, e.g. |z| in any D. 


13 (6) 
1. Find, if possible, z for which all terms in the Taylor series have the same phase. 
@ z= —irgivese’, (ii) sinhr, (iii) (sinh \/r)/Jr. 


2. 1/fin theorem 13.22. 
3. Theorem 12.62. 


5, Let o = exp(2zi/n), where n(2—«) > 27. Apply theorem 13.22 (corollary) to 
S(2)f(wz)...f(v"z) and then use exercise 12(a), 13. 
6. Write M = M(r), M, = M(r,), Ms = M(r2); p, @ integers. 

r?M® < max (r?M{, r?MQ). 


rp M¢ < r? Mg if and only if 
() z log (M, i/M,) 
q~  log(ra/r) * 


With such p,q we have r?M* < r2M4j, ie. 


Q) log M < Flos” +log My. 


The infimum of the p/q satisfying (1) is 
log (Mi/Mz) 
log (ra/rs) * 
(2) holds if p/q is replaced by this infimum. 


7. I f@) = Fans then f(r) = SJagl*r*". 
0 


@ L,(r) = 0. 
(ii) For theorem 13.22, suppose f(z) = 2a,(z—z»)" is regular in B(zo, R) and 
|f| has a maximum at zp. 
Then, if r is small enough, 
|ao|* = |f(Z0)|* > Zlan|*r*". 
Hence a, = 0 forn > 1. 
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Gi) Write u = logr and J(u) = I,(e") = = |an|2e2™ 


a? Jo" J? 
qa 8h =. 


Numerator 1s 
(2a, |? e™) SD an|*4n%e?™) — (Za, |? 2ne*)? > 0 (Schwarz). 


13 (c) 
1. The last three. tan 47z has poles when z is an odd integer. 
2. | f(r exp (27ip/2"))| > 00 as r>1—. 


3. By theorems 12.13, 13.13, 
i atin dp -3{ Lalli incipal val 
r e Soyer (principal value). 


m(x+r)\* 
2r 2 


Me de 
Write r? = x*+y?. re(r.h.s.) = i{ J e-" dt converges. 
0 


Analogue for integrals of Abel’s limit theorem gives 
ein mae 1 J us 
iC cos yt*dt tim 3 { ye 2A 2y* 


Ero a4 


4. If false, there is p for which (z—p)” converges for z = 1+46 > 1. The 


series is 


se =P es n(n=1)...1—V+ 1) agp". 


v=0 


« 
Terms are positive. pp» is }) an{(z—p)+p}", which therefore converges for 
y one 


z= 1+06. This contradicts R=1. 


5. No generality is lost by operating only with discs having rational centres and 
radii, z* with irrational a, log z. 


6. First part from theorem 13.11. 
0 
Ifx > 1, (1-224) (z) = Y(- 1)" n=. 
1 


Pog =1, 


Asz>1, $0) 5 jog2 


hs 


7. If 5 is small enough, the rectangle with corners —é+ 16, 1+6+70 is in D. 
Let 6 < b-a. 

Let C,, be the disc B(476; 6) for n = 0,1, .... 

Let a < 4ké < b. f and all its derivatives are real at x, = 4d, y = 0. From 
Taylor’s series in C,,, fand all its derivatives are real at x;,_, and so, successively, 
Clie et ee rr 
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Counterexample, a = 4, b = 3, f(z) = value of (z—4) which is positive 
fort}<x<i3,y=0. 

D = a simply-connected region containing z = 0 and segment G, of y=0 
and excluding z = 4. 


14 (@) 
1. Integrate round boundary of sector |z| < R, 0 < phz < 47, 


2. (a/n) cosec (77/n). Without evaluation, 


1 1 yn 1 
0<1- ae = [2% <[ wae. 
0 
EIS 
n-1 


Ree 9 1+x” 
de dx 
od o<(ite< 1 


3. Validity for a = b can be proved from theorem 8.73. 
Write og dx 


exe's J eo Ca? P+)” 
Suppose a is fixed and (say) ta <b < 3a. Integrand <1/(x*+a")*(x*+4a*) 
and of this exists. Hence the integral ¢(a, 5) converges uniformly for 


0 
4a < b < }a and so is continuous for b = a. 

Alternatively (and more simply) we may note that (for fixed a), d(a, b) de- 
creases as b increases. Hence 4(a,a—) > (a,a) = $(a,at+). As ba, the 
first and last of these have the same limit 37/8a°. 


4. If k < 0, value is —47e"*cos ka. If k = 0, f = 0. 
5. §11.2, example 3. Differentiate the factor 1/z. 


Cas z [E]+ fee - 0(2)+ fo(z) dz. 


<0 co 
6. | as in example 2. To prove f al ax = o( 5) : 
0 radar Xe Xx 


X, i xX, Xi gj 
[i= [sna] aa [hansen 
zx ax” |x Ix ax® 
8. Vertices ab, aB, Ab, AB. 
9. Ifyisz =e (0 <0 < 27), 


J- if akGSE I) da 
~ 4 Jy 2(2—W(kz-1)" 
Poles inside y at 0, k. 


If || > 1, put k =f. [=f Examine & = Sie 


10. Method of 9. 27/n!, 0. 


12. Rectangle of example 3, indented at 0, 277i. 
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14. Example 4 (method (i)). 


if pee) Cog 2) og x4 27 ae fee 24271) de = 2nites (4ni)-+ res (ri)} = nt. 


16. Sector |z| < R, 0 < phz < 47. 
The integral for 1/,/x states that it is its own Fourier transform if the definition 
of §9.9 is widened to admit unbounded integrands. (1/,/x in x > 0.) 


20 
17. By theorem 8.75, ¢’(x) -{ exp (—4u*)(—w sin ux)du. Integrate by parts. 
0 


18. For the latter, integrate sin zu/(e*—1), where a = ./(27), round the rect- 
angle 0, X, X+ 27i/a, 27i/a. Let X > 0. 
co 
19. From theorem 9.95, if if |g(t)| dt exists and g satisfies conditions for the 
-« 


convergence of its Fourier series at ¢, then 
U 20 
H{e(t+)+e(t—)} = ay lim i du f g(7) cos u(t—7) dr. 
27 u+0 J-U -% 

Since sin u(¢—7) is an odd function of u, the right-hand side is 
— iuk—T) 
Pa aime Hf ul a(re' dr. 

Put g(t) = e~*'f(t) if t > O and g(t) = 0 if ¢ < 0. Then, when ¢ > 0, 


HS(t+) + f(t—-)} = a He fi envi | S@ enattwT dr, 


=U 


The inner integral is F(a+ iu), 


14 (6) 
1, 2. 3. Method of §§14.2, 14.3, or derive from results obtained there; e.g. 
z—4 for z in §14.2 gives 
z 1 4. ar 
~ {z-(n+H)}* — cos*mz* 


Integrate, as in §14.3, to deduce 2, 
4. Poles of zu eo are at z = $(1 orw or w) where w=e*”"*; residues respectively 
4(1 or orw*), = as in $14.2, 


7 cot mt 
(ota ® 


and we have 
= ‘| tes ‘ jee 
eer ay (w cot 47H + w* cot 47w*), Simplify. 
r=l = 


8. (i) 42 coth 4z (which +1 as z+ 0) has Taylor’s series in |z] < R, where R 
is distance of nearest singularity, namely + 277i. 


CHAPTER 14 519 
(iii) Equate coefficients of z*" in 


cosh 4z = (2/z) sinh 4z=B,2"/n! 


ite. in s -(5 : h(E Bap ot 
a  2(2n)!— \o 2"2r+ DY ory 
14 (c) 
- oO o (-1)"" 
10. { } onright = DS DY @mn, where nn = zmn 
n=1m=1 n 
Now > lamn| = —log(1—|z|") < <2|z|" if m > mo 
=1 
o © 
Hence >y D Jamn| converges if |z| < 1. 
=1n=1 


By theorem 4.74, 
ss Side = >» > Qnn = > log(1+2™). 


n=1m=1 m=in=1 


Take exponential of each side. 


ea z 
11. cos7z = J] 1-75 


n=1 (n—4) 
12. (i) False. a, = 1/n log n. 
(ii) False. a, = or Da = or. 


n 
(iii) True. [[ tends to a finite limit, zero or non-zero according as La? diverges 
1 
or converges. 
13. (i) If p, is the kth prime, 
m 1 =i m a 
fi (1-1)" = (3 pn) = 3s 
k=1 Py k=1 \r=0 


where = means summation over all n not divisible by pms, ..- 
As m0, every integer m appears in D™ and r.h.s + (z). 


(ii) If x > 1, Zp-* (a sub-series of En-*) converges absolutely. Hence product 
converges, and so &(z) + 0. 


(ii) In @) write z = 1. As m-> 00, 2™ nt > co, Therefore II (1 —p~) diverges 
to 0. Then (theorem 14.41) Z(1/p) diverges. 
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14. Let g be a function with simple zeros at the a,. Then, for suitable Qn 


S ofr) Pn EXP (In(Z— an)} 
BO Gea) 


converges, q, = real janltiple of an. 


15. (i) Theorem 14.51. 
(ii) As for sy/sy in theorem 14,52. 
(iii) Theorem 13.11. 
(iv) (a) @(—z) is got from go(z) by rearranging terms of an absolutely 
convergent series. 
(6) Similar. 
(c) @'(z+20,) = —2E(z—Qyy, , + 20,)-*. The sets of points Qu» — 20, and 
Qn,n are the same. The series for (0’(z+20,) is a rearrangement of that 
for o’(z). 
(d) Integrating (c), (z+ 2u,) = (z)+A. z = —0, gives A = 0. 


1 


(v) @(z)—2-* = 2{ a} (even function) 


(=Qqy ny 
2 
= (ae ee ++ a if |z| small enough 


= Sais a, 
Thus {p(z)}3 = at os +3a3+ O(|z\), 


{e"(z) = 4-4 —16a;+ O(|z|). 
Hence {9'(2)} — 4{(0(z)}* + 20a, (9(z) + 28a, = O(|z|). 


Expression on left is an elliptic function, regular for all z and 0 for z = 0, 
hence = 0 (Liouville). 
The coefficients gy, g; are 60D’ OFS 1402/0755, 


14d) 
1 to 5 follow from § 14.6 (5), e.g. 
eee 1 (nt+I)(nt+o)(n+o%) _ can i 
2. to = ere ji (145) = 1 mn @rDT=0) 
_ Sin(—7w) _ cosh 47ry3 
Sere ae Sarge 
5. Product is 
z z\ _ ,m-4-42)(+42) 
(tp) (bg) Boe 
The rearranged product is 
yr A= 2-3) (4n—z—1)Qn+z) _ TTA) 
(4n—3)(4n—1)2n ~ T@-432) T—42)TU +42)’ 
vn 


which simplifies to FATG—40d +4) . 
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6. Pole at z = —n(n = 1, 2,...). 


(n+z)T(n+z) et) 
Residue Sie (n+-z)TU +z) = CARI SESRCES E) GaSe 
14 (e) 
L @ T(a)T (6) 1 Tia) T(6) 2a+d-2, 


T(a+6) oe ®) Te+5) 


(i fy where c = I'(4). 


2 ice 

© Fam’ reqs 
3. Integrate e~*z*“ round boundary of 3 < |z| < R,0 < phz < #7. 
4, Theorem 14.72. 
5. Integrate (z+ z~1)"z'~1 round the boundary of 6 < |z| <1, —4n < phz <4. 


Py 
6. Integrand is #7") e~"'. Justify inversion of sand =. 
1 
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